-- Logs begin at Thu 2020-12-03 02:48:11 UTC, end at Thu 2020-12-03 03:53:55 UTC. -- Dec 03 03:24:20.793748 dv-cinder-749155-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 03 03:24:20.801274 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Dec 3 03:24:20 2020] *** Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: nodename: dv-cinder-749155-3-iscsi Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: machine: x86_64 Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: clock source: unix Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: pcre jit disabled Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: detected number of CPU cores: 4 Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: current working directory: / Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: detected binary path: /usr/bin/uwsgi-core Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: dropping root privileges as early as possible Dec 03 03:24:20.803333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: your processes number limit is 47843 Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: your memory page size is 4096 bytes Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: detected max file descriptor number: 2048 Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: lock engine: pthread robust mutexes Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: thunder lock: enabled Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: dropping root privileges after socket binding Dec 03 03:24:20.804379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 03 03:24:20.848907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: Python main interpreter initialized at 0x55abe936f9c0 Dec 03 03:24:20.848907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: dropping root privileges after plugin initialization Dec 03 03:24:20.848907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: python threads support enabled Dec 03 03:24:20.848907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: your server socket listen backlog is limited to 100 connections Dec 03 03:24:20.848907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: your mercy for graceful operations on workers is 90 seconds Dec 03 03:24:20.849488 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: mapped 402621 bytes (393 KB) for 2 cores Dec 03 03:24:20.849488 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: *** Operational MODE: preforking *** Dec 03 03:24:20.849658 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: dropping root privileges after application loading Dec 03 03:24:20.849658 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: *** uWSGI is running in multiple interpreter mode *** Dec 03 03:24:20.849658 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: spawned uWSGI master process (pid: 79580) Dec 03 03:24:20.850067 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: spawned uWSGI worker 1 (pid: 79581, cores: 1) Dec 03 03:24:20.849703 dv-cinder-749155-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 03 03:24:20.850455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: spawned uWSGI worker 2 (pid: 79582, cores: 1) Dec 03 03:24:20.850455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 03 03:24:25.289090 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 03:24:25.290093 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 03:24:25.291051 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 03:24:25.291476 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 03:24:25.291761 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 03:24:25.292000 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 03:24:25.292212 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.292324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 03:24:25.292574 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.292929 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.293303 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.293663 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.293818 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 03:24:25.294010 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.294263 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 03:24:25.294382 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.294571 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 03:24:25.294717 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295033 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295136 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295396 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295495 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295753 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.295857 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296139 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296385 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296485 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296746 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-3-iscsi {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.296844 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297106 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297215 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297447 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297551 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.297890 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298142 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298268 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298508 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298607 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298813 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.298920 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.299171 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.299277 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.299543 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-3-iscsi {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.299773 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.299882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300115 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300213 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300456 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300579 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300802 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.300920 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301177 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301525 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301644 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301868 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.301983 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.302226 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.302508 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.302636 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.302858 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.302958 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.303209 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.303310 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.303565 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.303664 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-3-iscsi {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.303909 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304031 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304254 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304362 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304602 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304706 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.304986 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.305599 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.305718 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.305800 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.305869 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.305942 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.306010 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.306297 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.306428 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-3-iscsi {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.306659 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.306768 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307002 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307110 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307366 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307466 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307724 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.307830 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308082 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308183 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308446 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308554 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308782 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.308882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309121 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309462 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309572 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309817 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.309923 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310154 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310276 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310632 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310803 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.310902 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311143 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311242 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311503 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311613 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311858 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.311958 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312215 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312497 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312599 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312777 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.312886 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313130 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313230 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313479 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313584 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313813 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.313998 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314189 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314322 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314498 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314599 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314835 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.314942 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315117 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315218 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315485 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315591 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315823 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.315928 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316160 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316267 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316503 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316603 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316849 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.316958 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317187 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317293 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317524 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317632 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317865 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.317965 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.318211 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.318378 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.318588 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.318700 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.318927 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319034 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319284 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319384 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319637 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319745 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.319979 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.320078 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.320324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.320423 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.321253 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.321522 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.321643 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.321748 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.321895 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.322042 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.322305 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.322424 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.322676 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.322784 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323025 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323125 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323390 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323491 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323660 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323760 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.323969 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.324068 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.324312 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.324424 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.324671 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.324769 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325009 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325104 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325684 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325796 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.325984 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.326092 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.326351 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.326455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.326692 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.326794 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327030 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327138 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327367 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327475 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327695 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.327801 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328029 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328140 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328363 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328463 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328695 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.328793 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329032 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329139 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329380 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329479 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329724 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.329824 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330054 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330162 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330415 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330518 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330746 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.330847 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331082 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331193 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331423 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331543 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331752 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.331861 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332088 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332198 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332444 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332558 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332774 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.332882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333110 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333225 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333563 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333784 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.333899 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334121 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334230 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334487 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334596 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334810 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.334909 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335151 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335252 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335491 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335598 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335824 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.335947 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.336732 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.336928 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337094 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337336 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337490 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337639 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337753 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.337976 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.338086 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.338337 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.338452 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.338680 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.338780 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339119 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339451 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339704 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.339804 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340038 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340137 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340480 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340716 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.340822 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.341044 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.341142 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.341381 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.341589 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.341764 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.341918 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.342070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.342221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.342409 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.342581 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.342732 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.342893 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.343042 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.343203 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.343399 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:24:25.343579 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.343777 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.343942 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344091 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344253 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344414 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344619 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344774 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.344882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345121 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345466 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345566 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345810 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.345937 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.346167 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.346318 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.346549 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.346678 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.346914 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347258 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347359 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347603 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347703 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.347946 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.348068 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.348290 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.348398 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.348641 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.348742 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349002 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349103 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349354 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349455 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349691 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.349792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350041 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350141 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350417 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350537 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350776 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.350884 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.351137 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.351246 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.351487 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.351588 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.351865 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352478 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352584 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352690 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352883 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.352987 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.353083 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.353278 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.353395 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.353626 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.353732 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354001 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354113 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354391 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354589 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354724 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.354827 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355072 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355174 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355483 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355717 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.355818 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356064 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356167 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356404 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356504 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356759 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.356859 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357109 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357211 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357441 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357548 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357782 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.357882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358130 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358248 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358497 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358597 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358851 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.358968 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359190 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359292 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359536 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359636 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.359993 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.360223 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.360325 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.360569 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.360670 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.360908 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361016 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361247 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361348 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361594 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361694 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.361928 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362040 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362420 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362638 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362744 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.362984 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.363092 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.363322 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.363423 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.363659 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.363760 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364116 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364355 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364462 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364699 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.364800 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365044 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365145 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365396 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365502 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365729 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.365839 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366093 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366201 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366472 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366581 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366820 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.366928 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.367158 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.367259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.367600 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.367966 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368064 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368168 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368266 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368368 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368465 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368560 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368813 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.368980 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369152 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369490 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369591 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369830 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.369942 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370169 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370328 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370535 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370638 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370878 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.370997 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371218 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371319 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371557 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371671 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371888 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.371999 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.372224 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.372325 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.372560 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.372662 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.372925 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373305 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373305 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373499 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373601 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373697 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.373948 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374057 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374315 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374421 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374655 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374756 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.374996 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.375100 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.375338 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.375439 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.375683 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.375791 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376050 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376152 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376381 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376491 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376725 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.376840 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377066 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377169 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377405 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377505 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377749 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.377861 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378116 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378217 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378481 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378822 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.378935 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379163 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379263 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379507 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379608 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379854 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.379962 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380198 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380299 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380546 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380646 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380886 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.380994 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.381225 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.381326 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.381569 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.381668 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.381915 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.382023 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.382516 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.382625 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.382871 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.383494 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.383809 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384246 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384369 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384469 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384548 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384619 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384730 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.384936 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385040 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385403 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385645 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385758 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.385989 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.386089 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.386368 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.386483 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.386719 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.386828 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387054 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387161 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387394 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387502 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387742 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.387843 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388081 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388187 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388422 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388529 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388761 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.388863 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389200 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389442 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389542 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.389893 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390120 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390227 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390501 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390602 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390843 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.390945 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.391182 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.391283 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.391523 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.391631 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.391859 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392002 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392204 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392311 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392564 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392681 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.392905 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393006 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393250 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393357 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393596 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393706 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.393932 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.394039 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.394296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.394419 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.394648 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.394757 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395010 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395113 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395441 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395689 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.395797 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396031 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396132 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396437 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396543 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396714 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.396829 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.397055 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.397190 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.397420 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.397739 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.397848 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.398099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.398200 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.398476 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.398578 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.399357 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.399499 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.399861 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.399963 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.400035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.400130 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.400381 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.400745 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.400854 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401087 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401195 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401428 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401543 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401773 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.401874 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402112 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402212 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402486 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402657 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402833 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.402934 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403172 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403272 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403512 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403620 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403853 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.403960 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404199 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404306 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404531 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404640 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404871 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.404978 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405202 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405302 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405542 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405649 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405884 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.405983 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.406220 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.406365 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.406591 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.406693 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.406921 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407022 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407262 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407367 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407601 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407702 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.407938 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408039 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408275 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408377 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408617 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408723 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.408970 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.409071 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.409307 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.409407 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.409673 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.409774 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410027 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410133 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410399 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410744 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.410844 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411082 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411182 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411437 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411545 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411775 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.411881 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412113 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412262 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412457 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412565 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412796 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.412897 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413143 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413242 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413485 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413597 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413828 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.413929 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.414172 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.414765 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.414892 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.414999 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415097 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415191 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415285 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415489 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415592 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415825 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.415927 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416163 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416271 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416502 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416603 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416837 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.416944 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417170 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417270 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417508 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417612 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417860 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.417967 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.418196 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.418338 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.418565 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.418667 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.418904 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419011 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419236 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419344 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419571 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419672 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.419908 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420008 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420263 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420372 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420608 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420708 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.420937 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421043 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421280 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421391 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421620 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.421952 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422051 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422311 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422429 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422657 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422758 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.422994 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423094 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423331 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423440 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423660 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423760 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.423999 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.424099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.424340 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.424440 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.424687 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.424786 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425024 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425124 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425362 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425463 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425698 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.425797 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426028 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426136 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426394 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426497 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426744 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.426846 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427114 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427268 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427461 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427562 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427798 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.427898 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428144 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428245 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428489 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428596 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428821 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.428922 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429171 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429285 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429517 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429618 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429883 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.429995 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.430697 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.430816 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.430892 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.430969 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431039 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431106 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431237 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431395 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431588 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431755 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.431948 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.432107 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.432309 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.432447 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.432673 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.432774 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433012 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433113 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433357 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433466 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433700 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.433801 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434043 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434143 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434415 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434757 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.434865 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435101 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435208 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435448 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435551 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435791 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.435894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436137 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436244 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436473 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436580 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436815 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.436967 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437158 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437500 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437627 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437836 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.437937 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438180 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438344 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438551 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438633 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438889 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.438977 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440086 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440193 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440193 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440323 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440391 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440470 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440566 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440669 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440669 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440822 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.440916 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441010 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441215 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441567 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441668 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.441903 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442003 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442262 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442367 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442616 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442717 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.442966 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.443077 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.443303 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.443404 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.443759 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.443860 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444201 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444445 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444547 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444784 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.444884 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.445124 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.445224 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.445475 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446080 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446628 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446732 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446818 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446914 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.446995 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.447235 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.447338 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.447593 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.447726 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.447949 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448050 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448287 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448388 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448631 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448737 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.448987 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.449088 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.449359 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.449460 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.449709 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.449809 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450057 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450163 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450446 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450561 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450821 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.450922 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.451172 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.451273 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.451527 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.451628 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.451892 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452017 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452232 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452342 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452581 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452689 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.452929 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.453099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.453274 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.453458 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.453637 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.453819 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454001 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454194 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454372 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454593 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454694 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.454967 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.455067 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.455320 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.455469 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.455681 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.455788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456030 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456143 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456480 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456756 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.456857 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457129 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457237 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457482 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457838 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.457944 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.458188 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.458320 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.458574 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.458675 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.458913 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459252 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459360 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459597 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459697 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.459935 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460275 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460634 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460735 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.460973 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.461073 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.461663 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.461842 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.461922 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462024 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462121 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462307 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462435 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462729 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.462832 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463019 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463126 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463415 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463532 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.463828 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464171 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464424 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464536 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464780 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.464881 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465119 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465226 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465466 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465573 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465803 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.465904 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466142 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466260 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466508 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466610 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466844 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.466951 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467208 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467309 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467541 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467693 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467896 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.467997 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.468259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.468360 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.468608 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.468710 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.468945 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469045 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469302 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469402 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469649 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469751 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.469989 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.470090 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.470350 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.470467 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.470711 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.470819 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471048 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471149 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471384 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471493 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.471832 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472064 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472185 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472402 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472505 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472741 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.472882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473082 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473184 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473417 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473753 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.473856 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474089 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474196 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474475 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474588 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474815 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.474924 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475169 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475298 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475506 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475631 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475847 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.475955 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.476179 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.476280 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.476516 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.476622 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.477377 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.477846 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.477954 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478113 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478337 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478472 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478703 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.478807 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479062 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479164 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479429 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479531 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479779 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.479882 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480120 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480231 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480467 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480568 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480814 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.480917 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481163 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481273 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481512 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481613 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481862 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.481969 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.482211 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.482357 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.482585 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.482694 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.482932 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483052 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483273 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483382 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483620 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483721 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.483970 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.484071 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.484334 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.484551 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.484692 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.484922 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485026 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485445 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485643 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485745 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.485990 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.486097 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.486365 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.486483 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.486721 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.486827 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.487066 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.487170 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.487410 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.487659 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.487769 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488037 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488146 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488395 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488504 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488744 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.488845 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489097 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489204 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489450 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489560 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489810 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.489911 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490152 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490277 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490528 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490641 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490874 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.490975 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.491221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.491321 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.491566 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.491668 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.491939 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.492047 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.492273 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.492413 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.492949 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493097 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493200 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493304 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493535 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493646 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493890 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.493999 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.494275 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.494382 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.494614 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.494726 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.494971 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.495073 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.495324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.495425 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.495668 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.495777 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496017 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496118 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496363 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496464 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.496829 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497085 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497186 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497434 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497535 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497784 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.497885 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.498125 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.498227 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.498502 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.498615 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.498847 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499089 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499190 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499440 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499541 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499815 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.499918 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500179 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500284 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500543 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500645 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500895 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.500998 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.501245 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.501346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.501585 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.501692 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.501924 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.502176 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.502331 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.502565 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.502678 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.502921 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503258 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503359 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503600 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503701 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.503946 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504048 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504284 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504635 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504735 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.504971 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.505080 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.505310 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.505574 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.505681 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.505974 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.506083 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.506333 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.506449 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.506690 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.506798 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.507043 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.507153 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.507644 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.507755 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.508008 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.508180 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.508662 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.508788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.508889 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509093 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509196 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509446 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509556 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.509894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510131 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510497 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510608 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510844 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.510947 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511187 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511526 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511639 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511871 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.511972 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512208 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512309 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512560 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512673 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512893 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.512994 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.513231 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.513324 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.513570 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.513672 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.513907 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514261 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514366 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514616 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514725 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.514947 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515054 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515285 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515649 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515803 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.515910 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516007 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516255 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516370 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516594 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516696 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.516936 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517038 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517274 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517611 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517713 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.517948 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.518055 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.518330 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.518447 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.518679 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.518781 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519014 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519115 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519359 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519471 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519696 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.519798 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520040 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520141 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520379 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520492 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520723 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.520825 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.521070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.521177 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.521425 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.521536 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.521765 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522026 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522127 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522427 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522574 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.522898 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.523153 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.523254 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.523509 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.524187 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.524716 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.524827 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.524827 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.524958 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.525110 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.525221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.525470 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.525815 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.525925 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.526161 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.526283 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.526554 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.526657 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.526899 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527001 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527244 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527589 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527692 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.527933 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528033 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528275 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528389 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528614 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528721 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.528962 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.529064 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.529308 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.529421 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.529663 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.529765 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530005 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530116 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530377 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530496 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.530830 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531073 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531174 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531410 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531754 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.531862 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532098 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532199 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532438 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532542 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532810 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.532918 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533158 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533493 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533596 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533847 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.533956 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.534202 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.534330 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.534582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.534685 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.534942 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.535043 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.535294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.535403 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.535652 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.535760 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536022 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536123 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536375 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536485 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536723 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.536825 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537055 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537203 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537395 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537558 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537736 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.537918 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.538082 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.538354 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.538472 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.538712 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.538850 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.539091 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.539192 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.539595 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540035 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540204 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540302 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540398 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540694 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.540926 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541036 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541269 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541371 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541614 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541725 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.541969 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.542071 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.542346 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.542464 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.542703 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.542813 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543047 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543156 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543410 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543512 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543756 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.543859 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544106 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544208 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544443 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544544 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.544894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545129 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545232 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545477 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545580 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545831 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.545934 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546181 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546334 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546556 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546660 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.546997 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.547256 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.547360 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.547591 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.547700 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.547939 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.548041 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.548294 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.548403 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549027 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549147 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549390 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549492 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549755 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.549857 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550104 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550213 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550480 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550584 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550827 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.550929 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551166 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551276 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551512 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551613 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551857 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.551965 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.552221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.552358 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.552581 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.552684 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.552914 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553016 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553278 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553381 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553623 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553757 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.553971 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.554073 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.554338 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.554447 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.554687 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.554788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.555611 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556299 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556412 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556530 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556632 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556855 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.556965 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.557197 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.557299 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.557548 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.557651 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.557900 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558003 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558280 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558386 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558642 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558744 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.558991 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.559094 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.559371 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.559473 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.559712 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.559822 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.560065 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.560173 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.560416 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.560523 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.560686 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79582) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 03:24:25.560800 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.561099 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.561459 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.561831 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.562202 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.562600 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.562973 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.563369 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.563724 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.564120 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.564499 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:24:25.564780 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79581) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 03:24:25.599344 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79582) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:25.603676 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79581) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:25.957927 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.context [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6211385-f358-428e-b9cb-f335d3904874(cell1) {{(pid=79581) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 03:24:25.963718 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:24:25.965583 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:24:25.965711 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.context [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6211385-f358-428e-b9cb-f335d3904874(cell1) {{(pid=79582) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 03:24:25.966488 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:24:25.970286 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:24:25.971223 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79582) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:24:25.973231 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79582) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:24:25.973939 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79582) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:24:25.978936 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=79582) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:24:25.996591 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79581) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:25.997519 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79581) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:26.006802 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79582) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:26.007959 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79582) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:26.028252 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79581) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:26.040728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79582) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:24:26.206409 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading Gnome Dec 03 03:24:26.211073 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading Gnome Dec 03 03:24:26.227928 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading Google Dec 03 03:24:26.231153 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading Windows (alt) Dec 03 03:24:26.232738 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading Google Dec 03 03:24:26.235604 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading file Dec 03 03:24:26.236048 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading Windows (alt) Dec 03 03:24:26.236814 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading keyczar Dec 03 03:24:26.237258 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading multi Dec 03 03:24:26.238119 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Loading pyfs Dec 03 03:24:26.240732 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading file Dec 03 03:24:26.241829 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading keyczar Dec 03 03:24:26.242317 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading multi Dec 03 03:24:26.244323 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO keyring.backend [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Loading pyfs Dec 03 03:24:26.517598 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:24:26.525445 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:24:26.535865 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:24:26.543651 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:24:26.857412 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:24:26.863212 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:24:26.868819 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abe936f9c0 pid: 79581 (default app) Dec 03 03:24:26.871055 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:24:26.872259 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c0f5e6f8-cecc-4b3a-9fb9-b09e0068eb80 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001835 Dec 03 03:24:26.872689 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 779 bytes} [Thu Dec 3 03:24:26 2020] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:24:26.893271 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:24:26.899995 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WARNING keystonemiddleware.auth_token [None req-5fe5f733-eca4-47d1-a4ac-b81621f45e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:24:26.905321 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abe936f9c0 pid: 79582 (default app) Dec 03 03:25:52.711933 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-1cd38edc-8dae-4c7f-9fc0-946e6e364e72 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:25:52.736731 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-1cd38edc-8dae-4c7f-9fc0-946e6e364e72 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.526373 Dec 03 03:25:52.737339 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 2/2] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Dec 3 03:25:52 2020] GET /compute/v2.1/flavors/detail => generated 15 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:25:55.577993 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-0fed4337-1121-46bc-a918-e65bde0f0314 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:25:55.608484 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:25:55.608484 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:25:55.635528 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-0fed4337-1121-46bc-a918-e65bde0f0314 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.408902 Dec 03 03:25:55.636144 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 1/3] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:25:55 2020] POST /compute/v2.1/flavors => generated 367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:25:55.653640 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-775ea008-5010-4a98-8f7f-2f614b50b632 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:25:55.660702 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:25:55.660702 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:25:55.700878 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-775ea008-5010-4a98-8f7f-2f614b50b632 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.057642 Dec 03 03:25:55.701524 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 3/4] 10.222.0.66 () {62 vars in 1236 bytes} [Thu Dec 3 03:25:55 2020] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:25:55.717416 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-226fb0c6-12ad-4c0f-aabe-ebf6d369ed2a admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:25:55.740286 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-226fb0c6-12ad-4c0f-aabe-ebf6d369ed2a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032286 Dec 03 03:25:55.740863 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1183 bytes} [Thu Dec 3 03:25:55 2020] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:25:58.398832 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-7685afca-91a1-46aa-acdd-b80db0a3fc9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:25:58.428750 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:25:58.428750 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:25:58.456445 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-7685afca-91a1-46aa-acdd-b80db0a3fc9f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.162702 Dec 03 03:25:58.457159 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 4/6] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:25:58 2020] POST /compute/v2.1/flavors => generated 364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:25:58.476859 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c3eb4250-8039-4801-b8c4-933270e42678 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:25:58.482582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:25:58.482582 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:25:58.525762 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c3eb4250-8039-4801-b8c4-933270e42678 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.060578 Dec 03 03:25:58.526431 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 3/7] 10.222.0.66 () {62 vars in 1236 bytes} [Thu Dec 3 03:25:58 2020] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:25:58.544332 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-13071927-4076-46a3-98b6-97aabb5e8f77 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:25:58.566643 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-13071927-4076-46a3-98b6-97aabb5e8f77 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.033664 Dec 03 03:25:58.567254 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1183 bytes} [Thu Dec 3 03:25:58 2020] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:01.277369 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-dc18c7bc-a18e-490a-b3d2-deed75cf9e9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:01.305253 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-dc18c7bc-a18e-490a-b3d2-deed75cf9e9b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.115196 Dec 03 03:26:01.305862 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 4/9] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:01 2020] POST /compute/v2.1/flavors => generated 364 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:01.322746 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-5c78e61b-798d-487e-b5f5-d18317a1adab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:01.363127 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-5c78e61b-798d-487e-b5f5-d18317a1adab admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050222 Dec 03 03:26:01.363735 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 6/10] 10.222.0.66 () {62 vars in 1236 bytes} [Thu Dec 3 03:26:01 2020] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:01.378830 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b10c120a-4c24-4e30-8cde-349338503df2 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:01.400637 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b10c120a-4c24-4e30-8cde-349338503df2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030728 Dec 03 03:26:01.401209 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 5/11] 10.222.0.66 () {58 vars in 1183 bytes} [Thu Dec 3 03:26:01 2020] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:03.997204 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-d4825989-4ea3-4d42-b8e0-534eed600ab8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:04.024463 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-d4825989-4ea3-4d42-b8e0-534eed600ab8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113728 Dec 03 03:26:04.025061 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 7/12] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:03 2020] POST /compute/v2.1/flavors => generated 364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:04.041999 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-dd1c1a34-1b60-4a14-9530-38035e2ec118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:04.083289 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-dd1c1a34-1b60-4a14-9530-38035e2ec118 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051215 Dec 03 03:26:04.084511 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 6/13] 10.222.0.66 () {62 vars in 1236 bytes} [Thu Dec 3 03:26:04 2020] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:04.100503 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-14235366-77d3-471c-a88c-7c73d66fee3e admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:04.122800 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-14235366-77d3-471c-a88c-7c73d66fee3e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031828 Dec 03 03:26:04.123380 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1183 bytes} [Thu Dec 3 03:26:04 2020] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:06.731853 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-e2a20bf4-ab1b-4a5e-8d44-bda73a9b2846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:06.760931 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-e2a20bf4-ab1b-4a5e-8d44-bda73a9b2846 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.117134 Dec 03 03:26:06.761554 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 7/15] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:06 2020] POST /compute/v2.1/flavors => generated 364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:06.777745 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-bcd31c69-6b60-4724-a78a-ded896cda09a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:06.818874 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-bcd31c69-6b60-4724-a78a-ded896cda09a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049509 Dec 03 03:26:06.819477 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 9/16] 10.222.0.66 () {62 vars in 1236 bytes} [Thu Dec 3 03:26:06 2020] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:06.834645 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-03c1cbd2-f0f1-4c3f-ae45-884ec50413c4 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:06.856966 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-03c1cbd2-f0f1-4c3f-ae45-884ec50413c4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031204 Dec 03 03:26:06.857547 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 8/17] 10.222.0.66 () {58 vars in 1183 bytes} [Thu Dec 3 03:26:06 2020] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:09.465497 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-a7083eca-2311-44db-b071-33a10e5a7051 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:09.485159 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-a7083eca-2311-44db-b071-33a10e5a7051 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.108252 Dec 03 03:26:09.485690 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Dec 3 03:26:09 2020] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:26:12.106296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-a8121385-16cf-4fd9-a4db-2f3bf9c40f7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:12.134396 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-a8121385-16cf-4fd9-a4db-2f3bf9c40f7c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.114225 Dec 03 03:26:12.135003 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 9/19] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:12 2020] POST /compute/v2.1/flavors => generated 362 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:12.151800 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-65d09e7f-27d5-4524-a4b0-adfecfae6332 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:12.196049 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-65d09e7f-27d5-4524-a4b0-adfecfae6332 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.054045 Dec 03 03:26:12.196682 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 11/20] 10.222.0.66 () {62 vars in 1233 bytes} [Thu Dec 3 03:26:12 2020] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:12.212223 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-31a64944-9f5a-4797-9951-abf7dabde358 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:12.232770 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-31a64944-9f5a-4797-9951-abf7dabde358 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029743 Dec 03 03:26:12.233343 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1180 bytes} [Thu Dec 3 03:26:12 2020] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:14.875917 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-f30b9536-e7ab-4b79-a3b3-ebd886865e60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:14.904626 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-f30b9536-e7ab-4b79-a3b3-ebd886865e60 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.125885 Dec 03 03:26:14.905171 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 12/22] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:14 2020] POST /compute/v2.1/flavors => generated 365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:14.921580 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-02703f61-3560-4445-a5ce-8317b5b1ad4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:14.962754 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-02703f61-3560-4445-a5ce-8317b5b1ad4c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050322 Dec 03 03:26:14.963388 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 11/23] 10.222.0.66 () {62 vars in 1233 bytes} [Thu Dec 3 03:26:14 2020] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:14.978629 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-14069856-97c5-4bd6-baae-61be04f15813 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:14.999413 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-14069856-97c5-4bd6-baae-61be04f15813 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029844 Dec 03 03:26:14.999985 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 13/24] 10.222.0.66 () {58 vars in 1180 bytes} [Thu Dec 3 03:26:14 2020] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:17.696764 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-993c3ac2-0477-4598-b2bd-9571f2363d4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:17.724142 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-993c3ac2-0477-4598-b2bd-9571f2363d4c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.116929 Dec 03 03:26:17.724687 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 12/25] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:17 2020] POST /compute/v2.1/flavors => generated 366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:17.741004 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-9351f7d9-238c-463c-9863-aaacafa3abed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:17.787629 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-9351f7d9-238c-463c-9863-aaacafa3abed admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.055789 Dec 03 03:26:17.788264 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 14/26] 10.222.0.66 () {62 vars in 1233 bytes} [Thu Dec 3 03:26:17 2020] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:17.803648 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-4920d6c8-8478-4062-bb71-a89077281f12 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:17.824647 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-4920d6c8-8478-4062-bb71-a89077281f12 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030029 Dec 03 03:26:17.825222 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 13/27] 10.222.0.66 () {58 vars in 1180 bytes} [Thu Dec 3 03:26:17 2020] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:20.449070 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-f3e66866-0e7f-4521-b0fb-794fdc29c53a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:20.478140 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-f3e66866-0e7f-4521-b0fb-794fdc29c53a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.116834 Dec 03 03:26:20.478728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 15/28] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:20 2020] POST /compute/v2.1/flavors => generated 365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:20.495003 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-1db0e61a-8651-4590-b7d7-03123b380851 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:20.536136 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-1db0e61a-8651-4590-b7d7-03123b380851 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050389 Dec 03 03:26:20.537550 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 14/29] 10.222.0.66 () {62 vars in 1233 bytes} [Thu Dec 3 03:26:20 2020] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:20.553617 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-eb41d94b-1a1f-4f52-bf80-a7c82dcea55b admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:20.574410 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-eb41d94b-1a1f-4f52-bf80-a7c82dcea55b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030290 Dec 03 03:26:20.575036 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 16/30] 10.222.0.66 () {58 vars in 1180 bytes} [Thu Dec 3 03:26:20 2020] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:23.169296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-8029ecf5-159d-43a6-9d69-75a995f6f213 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:23.197649 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-8029ecf5-159d-43a6-9d69-75a995f6f213 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.115475 Dec 03 03:26:23.198307 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 15/31] 10.222.0.66 () {62 vars in 1183 bytes} [Thu Dec 3 03:26:23 2020] POST /compute/v2.1/flavors => generated 368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:26:23.214585 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-f6fd8f41-42df-40b7-81f5-d39c7fffc257 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:26:23.255864 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-f6fd8f41-42df-40b7-81f5-d39c7fffc257 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050277 Dec 03 03:26:23.256487 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 17/32] 10.222.0.66 () {62 vars in 1233 bytes} [Thu Dec 3 03:26:23 2020] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:26:23.272706 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-09fb4ed6-7d02-4ed9-9575-f59850bcb662 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:26:23.293655 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-09fb4ed6-7d02-4ed9-9575-f59850bcb662 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030538 Dec 03 03:26:23.294228 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 16/33] 10.222.0.66 () {58 vars in 1180 bytes} [Thu Dec 3 03:26:23 2020] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:27:34.966557 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-1fe9ca78-9998-48ab-8e5a-f7fdaca0a11c admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:34.991627 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-1fe9ca78-9998-48ab-8e5a-f7fdaca0a11c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.112226 Dec 03 03:27:34.992216 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 18/34] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Dec 3 03:27:34 2020] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:27:36.675031 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-09fb4ed6-7d02-4ed9-9575-f59850bcb662 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:36.676165 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-09fb4ed6-7d02-4ed9-9575-f59850bcb662 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Dec 03 03:27:36.676610 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 17/35] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:36 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:36.895414 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-e8588f5b-4b80-4644-aadf-9077402099b5 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:36.910123 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-e8588f5b-4b80-4644-aadf-9077402099b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 03 03:27:36.910784 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-e8588f5b-4b80-4644-aadf-9077402099b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:36.912378 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-e8588f5b-4b80-4644-aadf-9077402099b5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.108622 Dec 03 03:27:36.913066 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 19/36] 10.222.0.66 () {60 vars in 1181 bytes} [Thu Dec 3 03:27:36 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:36.928836 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4c62398-a9c0-47df-b778-3edeb1bce211 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:36.951145 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4c62398-a9c0-47df-b778-3edeb1bce211 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031854 Dec 03 03:27:36.951716 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:36 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:36.968806 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-17bb675a-51fe-4b8d-a715-8bf7f732f930 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:36.993033 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-17bb675a-51fe-4b8d-a715-8bf7f732f930 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.034899 Dec 03 03:27:36.993609 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 20/38] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:36 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:37.009672 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-5edb6e8b-5dd9-4e0f-87f3-e1d82dd7b253 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:37.024176 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-5edb6e8b-5dd9-4e0f-87f3-e1d82dd7b253 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 03 03:27:37.024810 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-5edb6e8b-5dd9-4e0f-87f3-e1d82dd7b253 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:37.025664 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-5edb6e8b-5dd9-4e0f-87f3-e1d82dd7b253 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.025712 Dec 03 03:27:37.026221 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1181 bytes} [Thu Dec 3 03:27:36 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:38.555015 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-17bb675a-51fe-4b8d-a715-8bf7f732f930 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:38.556087 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-17bb675a-51fe-4b8d-a715-8bf7f732f930 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Dec 03 03:27:38.556519 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 21/40] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:38 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:38.771319 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-f9bef70b-ffa0-4160-adf3-f46dca85d7bf admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:38.784598 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-f9bef70b-ffa0-4160-adf3-f46dca85d7bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 03 03:27:38.785320 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-f9bef70b-ffa0-4160-adf3-f46dca85d7bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:38.786792 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-f9bef70b-ffa0-4160-adf3-f46dca85d7bf admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.103528 Dec 03 03:27:38.787370 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1181 bytes} [Thu Dec 3 03:27:38 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:38.803261 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-ae2b548c-8adf-487b-b21a-a085a1ca3e00 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:38.824720 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-ae2b548c-8adf-487b-b21a-a085a1ca3e00 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031101 Dec 03 03:27:38.825292 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:38 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:38.840866 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-cdac78ff-c3ed-41d0-8247-8574f0170925 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:38.865821 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-cdac78ff-c3ed-41d0-8247-8574f0170925 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.033883 Dec 03 03:27:38.866431 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 21/43] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:38 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:38.882190 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-0e36c757-be89-4708-bdfb-d450707df8ae admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:38.895421 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-0e36c757-be89-4708-bdfb-d450707df8ae admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 03 03:27:38.896102 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-0e36c757-be89-4708-bdfb-d450707df8ae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:38.896986 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-0e36c757-be89-4708-bdfb-d450707df8ae admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.024040 Dec 03 03:27:38.897531 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1181 bytes} [Thu Dec 3 03:27:38 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:40.434639 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-cdac78ff-c3ed-41d0-8247-8574f0170925 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:40.435714 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-cdac78ff-c3ed-41d0-8247-8574f0170925 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Dec 03 03:27:40.436148 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 22/45] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:40 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:40.650458 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-5b2cc0b9-585e-40a2-8699-86e64a4799ae admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:40.663296 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-5b2cc0b9-585e-40a2-8699-86e64a4799ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 03 03:27:40.663910 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-5b2cc0b9-585e-40a2-8699-86e64a4799ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:40.664750 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-5b2cc0b9-585e-40a2-8699-86e64a4799ae admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.100106 Dec 03 03:27:40.665298 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:27:40 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:40.681345 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b336bfc3-15a0-42a2-90e3-18fe1843ea10 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:40.703414 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b336bfc3-15a0-42a2-90e3-18fe1843ea10 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031850 Dec 03 03:27:40.703971 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:40 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:40.719843 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:40.742387 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031427 Dec 03 03:27:40.743011 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 25/48] 10.222.0.66 () {60 vars in 1201 bytes} [Thu Dec 3 03:27:40 2020] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:27:40.760155 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-12ae9c0e-6893-4ff0-8d8a-d533f8be41b7 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:40.773823 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.wsgi [None req-12ae9c0e-6893-4ff0-8d8a-d533f8be41b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 03 03:27:40.774629 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-12ae9c0e-6893-4ff0-8d8a-d533f8be41b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:27:40.775484 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-12ae9c0e-6893-4ff0-8d8a-d533f8be41b7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.025264 Dec 03 03:27:40.776052 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:27:40 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 03 03:27:42.310092 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:42.311213 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Dec 03 03:27:42.311647 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 26/50] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:42 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:42.524692 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-417a9107-5286-4211-9180-9349d3d7011e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:27:42.560977 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-417a9107-5286-4211-9180-9349d3d7011e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.121845 Dec 03 03:27:42.561592 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 25/51] 10.222.0.66 () {64 vars in 1226 bytes} [Thu Dec 3 03:27:42 2020] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:27:44.119672 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:44.120842 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Dec 03 03:27:44.121377 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 27/52] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:44 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:44.340701 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-4cae306c-3de3-42ce-8119-8e478a9a19a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:27:44.375040 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-4cae306c-3de3-42ce-8119-8e478a9a19a5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.122867 Dec 03 03:27:44.375573 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 26/53] 10.222.0.66 () {64 vars in 1226 bytes} [Thu Dec 3 03:27:44 2020] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:27:45.937556 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:45.938651 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Dec 03 03:27:45.939089 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 28/54] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:45 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:46.155877 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-95ccc060-1cac-4266-b970-913522a6daff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:27:46.193287 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-95ccc060-1cac-4266-b970-913522a6daff admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.127168 Dec 03 03:27:46.193889 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 27/55] 10.222.0.66 () {64 vars in 1226 bytes} [Thu Dec 3 03:27:46 2020] POST /compute/v2.1/flavors => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:27:47.740029 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:47.741097 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Dec 03 03:27:47.741537 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 29/56] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:47 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:47.958095 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-04f9a757-3764-49cf-a52f-1c82be49672f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:27:47.991788 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-04f9a757-3764-49cf-a52f-1c82be49672f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.123987 Dec 03 03:27:47.992388 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 28/57] 10.222.0.66 () {64 vars in 1226 bytes} [Thu Dec 3 03:27:47 2020] POST /compute/v2.1/flavors => generated 409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:27:49.540579 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:49.541636 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 03 03:27:49.542071 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 30/58] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:27:49 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:27:49.756474 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-e5fbda82-f91e-4479-b05f-d08ca73029ce admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:27:49.794066 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-e5fbda82-f91e-4479-b05f-d08ca73029ce admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.123650 Dec 03 03:27:49.794689 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 29/59] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Dec 3 03:27:49 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:28:40.528215 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:28:40.529289 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-c4b74196-b882-4893-8ad7-112663d3737f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Dec 03 03:28:40.529728 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 31/60] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:28:40 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:28:40.746824 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:28:40.780036 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.122032 Dec 03 03:28:40.780617 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 30/61] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Dec 3 03:28:40 2020] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:29:56.578331 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-e2310c4b-d329-4075-add6-891264579cfa tempest-verify_tempest_config-2083716418 tempest-verify_tempest_config-2083716418] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:29:56.585520 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-e2310c4b-d329-4075-add6-891264579cfa tempest-verify_tempest_config-2083716418 tempest-verify_tempest_config-2083716418] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.166707 Dec 03 03:29:56.586092 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 32/62] 10.222.0.66 () {58 vars in 1124 bytes} [Thu Dec 3 03:29:56 2020] GET /compute/v2.1/extensions => generated 22700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:31:36.756461 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:36.757540 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Dec 03 03:31:36.757983 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 31/63] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:31:36 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:31:37.049298 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:37.055587 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:31:37.055587 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:31:37.057158 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:37.057778 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:37.058632 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:37.059109 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:37.093504 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-6879c5da-154c-47c0-8c39-f1cd56d97304 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.202771 Dec 03 03:31:37.094118 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:31:36 2020] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:31:38.658931 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:38.660100 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Dec 03 03:31:38.660589 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 32/65] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:31:38 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:31:38.879151 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:38.885514 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:31:38.885514 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:31:38.887094 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:38.887584 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:38.888418 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:38.888887 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:38.913677 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-30bc9347-544c-4ee2-905b-adad93e799fa admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.123616 Dec 03 03:31:38.914268 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:31:38 2020] GET /compute/v2.1/os-services => generated 791 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:31:50.919485 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:50.920609 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Dec 03 03:31:50.921046 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 33/67] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:31:50 2020] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:31:51.138539 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:51.144685 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:31:51.144685 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:31:51.146289 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:51.146775 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:51.147614 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:51.148120 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:51.181681 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-92738767-c9e6-4fd6-93c7-9edeb2d477ca admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.133241 Dec 03 03:31:51.182480 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:31:51 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:31:52.742818 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] Calling method '>' {{(pid=79582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:52.743876 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-b248ee59-d21e-44e6-92c3-814b37d223d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Dec 03 03:31:52.744309 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79582|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1065 bytes} [Thu Dec 3 03:31:52 2020] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:31:52.966665 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG nova.api.openstack.wsgi [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] Calling method '>' {{(pid=79581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:31:52.972809 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:31:52.972809 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: warnings.warn(msg) Dec 03 03:31:52.974390 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:52.974883 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:52.975720 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:31:52.976197 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: DEBUG oslo_concurrency.lockutils [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79581) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:31:53.010086 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: INFO nova.api.openstack.requestlog [None req-115e1600-60d1-495a-a177-4f2eef3d06ec admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.134548 Dec 03 03:31:53.010766 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: [pid: 79581|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Dec 3 03:31:52 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:32:50.469775 dv-cinder-749155-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 03 03:32:50.470633 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: Thu Dec 3 03:32:50 2020 - graceful shutdown triggered... Dec 03 03:32:50.471123 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: Gracefully killing worker 1 (pid: 79581)... Dec 03 03:32:50.471251 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: Gracefully killing worker 2 (pid: 79582)... Dec 03 03:32:51.471894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: worker 1 buried after 1 seconds Dec 03 03:32:51.471894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: worker 2 buried after 1 seconds Dec 03 03:32:51.471894 dv-cinder-749155-3-iscsi devstack@n-api.service[79580]: goodbye to uWSGI. Dec 03 03:32:51.473910 dv-cinder-749155-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 03 03:32:51.475654 dv-cinder-749155-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 03 03:32:51.485093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Dec 3 03:32:51 2020] *** Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: nodename: dv-cinder-749155-3-iscsi Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: machine: x86_64 Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: clock source: unix Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: pcre jit disabled Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: detected number of CPU cores: 4 Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: current working directory: / Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: detected binary path: /usr/bin/uwsgi-core Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: dropping root privileges as early as possible Dec 03 03:32:51.487175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: your processes number limit is 47843 Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: your memory page size is 4096 bytes Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: detected max file descriptor number: 2048 Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: lock engine: pthread robust mutexes Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: thunder lock: enabled Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: dropping root privileges after socket binding Dec 03 03:32:51.488088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 03 03:32:51.533387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Python main interpreter initialized at 0x55583a8549c0 Dec 03 03:32:51.533387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: dropping root privileges after plugin initialization Dec 03 03:32:51.533387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: python threads support enabled Dec 03 03:32:51.533387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: your server socket listen backlog is limited to 100 connections Dec 03 03:32:51.533387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: your mercy for graceful operations on workers is 90 seconds Dec 03 03:32:51.533910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: mapped 402621 bytes (393 KB) for 2 cores Dec 03 03:32:51.533910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: *** Operational MODE: preforking *** Dec 03 03:32:51.534095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: dropping root privileges after application loading Dec 03 03:32:51.534095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: *** uWSGI is running in multiple interpreter mode *** Dec 03 03:32:51.534095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: spawned uWSGI master process (pid: 94247) Dec 03 03:32:51.534205 dv-cinder-749155-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 03 03:32:51.534597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: spawned uWSGI worker 1 (pid: 94249, cores: 1) Dec 03 03:32:51.535117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: spawned uWSGI worker 2 (pid: 94250, cores: 1) Dec 03 03:32:51.535117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 03 03:32:56.118181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 03:32:56.118821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 03:32:56.120101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 03:32:56.120553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 03:32:56.120864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 03:32:56.121343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.121726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.122100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.122526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.122899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.123272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.123654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.124015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.124390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.124762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.125147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.125454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.125820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.126202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-3-iscsi {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.126612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.126972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.127332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.127725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.128082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.128460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.128814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.129459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.129821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.130173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.130596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.131006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.131371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.131733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.132114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.132638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.133002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.133384 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.133740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-3-iscsi {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.134117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.134510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.135143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.135674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.136034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.136397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.136776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.137149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.137506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.137893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.138288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.138668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.139043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.139372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.139735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.140093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.140465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.140822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.141181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.141477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.141831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.142208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.142632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.143017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.143311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.143604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.143979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.144356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.144713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.145069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.145424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.145780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.146133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.146514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.146871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.147228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.147601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.148518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.148951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.149876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.150638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.150638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.151293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.151406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.151969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.152405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.152739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.153096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.153474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.153838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.154195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.154589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.154964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.155339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.155692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.155988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.156339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.156694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.157063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.157421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.157774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.158127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.158506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.158866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.159228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.159572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.159924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.160277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.160630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.160984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.161345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.161715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.162081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.162487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.162845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.163199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.164137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.164623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.164955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.165307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.165662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.166039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.166422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.166778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.167149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.167504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.167858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.168230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.168577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.168932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.169304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.169656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.170010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.170389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.170742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.171094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.171528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.171773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.172122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.172468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.172843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.173219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.173577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.173929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.174311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.174759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.175132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.175457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.175857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.176224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.176612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.177038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.177371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.177735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.178101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.178511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.178876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.179352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.179636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.180010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.180383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.180769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.181140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.181511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.181881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.182409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.182611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.182971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.183320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.183687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.184089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.184604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.184829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.185266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.185552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.185930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.186329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.186701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.187063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.187424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.187786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.188186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.188557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.188905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.189257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.189615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.189967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.190353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.190713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.191094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.191479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.191839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.192254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.192565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.192926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.193287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.193640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.194003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.194389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.194791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.195171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.195602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.195864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.196239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.196408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 03 03:32:56.196587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.196748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 03 03:32:56.196912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.197260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.197620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.197978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.198274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 03 03:32:56.198448 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.198709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 03 03:32:56.198866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.199035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 03 03:32:56.199188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.199399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.199565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.199862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.200053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.200207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.200361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.200524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.200687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.200848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.201022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.201183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.201344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.201497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.201659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.201810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.201991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.202155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.202450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.202697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.202865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.203019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.203189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.203189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.203491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.203642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.203808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.203982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-3-iscsi {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.204134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.204134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.204457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.204624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.204859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.205039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.205191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.205356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.205519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.205641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.205742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.205851 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.205959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.206142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.206319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.206519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.206777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.206904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.207129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.207242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.207480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.207592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.207834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.207941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.208281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.208411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.208561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.208673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.208913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.209020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.209284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.209389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.209630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.209888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.210017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.210948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.211199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.211313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.211403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.211512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-3-iscsi {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.211615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.211864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.211971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.212209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.212321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.212563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.212689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.212925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.213049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.213309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.213416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.213669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.213782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.214030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.214136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.214444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.214564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.214793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.214913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.215146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.215270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.215504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.215623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.215865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.215977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.216260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.216395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.216545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.216665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.216897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.217048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.217243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.217397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.217593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.217750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.217937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.218094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.218312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.218538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.218693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.218844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.218995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.219210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.219358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.219502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.219658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.219808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.219958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.220101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.220369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.220537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.220692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.220838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.220981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.221125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.221267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.221424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.221569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.221718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.221868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.222019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.222288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.222458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.222717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.222879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.223126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.223273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.223428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.223580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.223731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.223874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.224016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.224158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.224310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.224461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.224661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.224818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.225029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.225196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.225444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.225600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.225754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.225898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.226107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.226878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.227041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.227214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.227407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.227734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.227899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.228043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.228194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.228406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.228562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.228770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.228926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.229135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.229291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.229492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.229641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.229841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.229997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.230192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.230397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.230673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.230823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.230974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.231123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.231279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.231430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.231579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.231722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.231866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.232015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.232171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.232322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.232514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.232910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.233069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.233300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.233421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.233637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.233821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.233977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.234126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.234374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.234539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.234769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.235151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.235325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.235580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.235744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.235896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.236047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.236191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.236344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.236489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.236641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.236784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.237041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.237196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.237348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.237498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.237655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.237813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.238055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.238205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.238372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.238531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.238684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.238827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.239011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.239167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.239365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.239526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.239743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.239891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.240097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.240257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.240464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.240779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.240945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.241091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.241249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.241507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.241705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.241846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.242084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.242276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.242436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.242589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.242841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.243189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.243445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.243600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.243600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.243882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.244038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.244182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.244332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.244476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.244618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.244767 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.244982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.245138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.245337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.245494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.245745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.245894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.246047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.246199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.246375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.246523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.246674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.246818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.246973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.247223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.247371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.247524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.247676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.247829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.247986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.248234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.248382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.248526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.248718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.248943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.249097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.249241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.249391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.249534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.249732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.249889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.250083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.250288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 03 03:32:56.250442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.250587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.250803 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.251982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.252962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.253276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.253447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.253666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.253828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.253986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.254897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.255918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.256847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.257279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.257418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.257684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.257842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.258084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.258330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.258500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.258618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.258859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.259032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.259217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.259434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.259558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.260251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.260834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.261784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.261926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.261926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.264045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.265584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.265709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.265826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.265948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.266065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.266177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.266528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.266648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.266648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.267772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.267905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.268921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.269970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.270858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.271977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.272242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.272353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.272455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.272611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.272757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.273451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.273606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.273751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.274938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.275890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.276965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.277921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.278995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.279947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.280987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.281235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.281349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.281593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.281705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.281941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.282049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.282316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.282471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.282671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.282800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.283872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.284968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.285157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.285269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.285509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.285613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.285867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.286051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.286314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.286501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.286675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.286828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.287848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.288017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.288172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.288343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.288571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.289267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.289424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.289601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.289769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.289954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.290148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.290353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.290527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.290732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.290907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.291916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.292042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.292144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.292297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.292660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.292773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.293970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.294203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.294372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.294822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.294926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.295016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.295348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.295476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.295703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.295998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.296101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.296503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.296627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.296704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.296950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.297054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.297328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.297445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.297725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.297829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.298903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.299142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.299494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.299599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.299675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.299840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.300938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.301164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.301317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.301531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.301717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.301889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.302987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.303152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.303354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.303503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.303714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.303856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.304105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.304339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.304630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.304975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.305080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.305427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.305545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.305682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.305787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.306900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.307988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.308234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.308369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.308585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.308694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.308938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.309042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.309296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.309400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.310893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.311850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.312982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.313191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.313387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.313570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.313742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.313925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.314994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.315233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.315329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.315576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.315673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.315966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.316966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.317317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.317492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.317666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.317835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.317993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.318759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.319031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.319135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.319388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.319513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.320281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.320400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.320595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.320831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.320951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.321293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.321418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.321650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.321814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.322046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.322322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.322447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.322719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.322835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.323954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.324985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.325233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.325345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.325588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.325745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.325937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.326099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.326313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.326457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.326669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.326789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.327805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.328866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.329974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.330971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.331139 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.331357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.331471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.331726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.331833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.332104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.332280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.332455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.332594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.332816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.333852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.334992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.335232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.335424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.336142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.336354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.336469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.336632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.336861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.337131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.337387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.337553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.337741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.337932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.338118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.338336 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.338508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.338683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.338866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.339922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.340870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.341987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.342222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.342511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.342699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.342874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.342991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.343093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.343253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.343474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.343650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.343834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.344926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.345093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.345304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.345579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.345751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.345910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.346076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.346333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.346670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.346901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.347068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.347227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.347532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.347722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.347895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.348053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.348219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.348381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.348628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.348789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.349949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.350187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.350443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.350607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.350844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351018 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.351972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.352989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.353162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.353342 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.353518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.353749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.354986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.355194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.355363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.355538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.355687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.355837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.356026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.356174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.356492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.356826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.357125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.357410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.357585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.357857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.358066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.358256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.358587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.358761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.358938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.359170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.359340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.359539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.359702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.359901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.360113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.360371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.360600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.360930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.361488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.361619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.361908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.362088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.362271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.362370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.362633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.362761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363384 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.363922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.364934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.365115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.365373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.365540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.365735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.365973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.366163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.366391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.366577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.366791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.367028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.367146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.367258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.367676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.367784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.368041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.368289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.368444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.368818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.368931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.369187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.369467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.369573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.369895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.370070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.370269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.370642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.370795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.371002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.371366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.371481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.371727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.371983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.372097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.372454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.372569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.372811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.373141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.373314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.373677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.373790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.374050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.374437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.374553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.374802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.374995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.375213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.375591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.375702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.375976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.376205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.376358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.376715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.376875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.377092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.377401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.377516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.377759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.378144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.378354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.378562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.378856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.378977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.379278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.379396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.379663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.379771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.380028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.380141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.380388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.380760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.380924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.381117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.381355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.381530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.381730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.381889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.382123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.382846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.383160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.383259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.383836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.384026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.384197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.384395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.384574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.385985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.386081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.386224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.386506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.386865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.387317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.387617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.387617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.388109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.388369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.388633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.388900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.389665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.390021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.390157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.390391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.390614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.391839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.392879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.393910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.394076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.394229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.394431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.394626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.394888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.395197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.395393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.395570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.395757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.396850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.397006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.397172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.397391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.397621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.397912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.399480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.399643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.399817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.399997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.400156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.400316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.400466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.400639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.400830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.401926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.402856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.403861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94250) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 03:32:56.404201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.404201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.404414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.404629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.404995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.405356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.405710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.406075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.406535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.406831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.407503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.407859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.408244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.408603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.408962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.409322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.409691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.410048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.410441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.410800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.411163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.411519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.411898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.412282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.412665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.413058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.413440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.413853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.414217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.414611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.415034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.415409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.415762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.416131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.416500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.416880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.417295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.417582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.418308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.418308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.418640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.418995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.419357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.419926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.420127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.420468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.420835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.421200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.421561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.421922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.422609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.422962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.423304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.423780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.424064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.424422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.424835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.425143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.425497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.425840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.426195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.426599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.426946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.427299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.427707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.428002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.428366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.428719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.429429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.429832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.430203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.430609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.430995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.431360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.431715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.432124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.432446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.432796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.433301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.433589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.433946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.434314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.435458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.435458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.435458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.435792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.436007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.436380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.436730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.437081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.437429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.437785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.438136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.438795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.438912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.439188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.439546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.439883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.440224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.440617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.440931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.441284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.441642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.441991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.442417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.442761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.443102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.443475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.443838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.444207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.444565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.445456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.445863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.446080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94250) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.446453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.447082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.447446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.447816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.448221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.448619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.448968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.449316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.449664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.450032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.450449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.450801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.451154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.451513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.451866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.452220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.452573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.452924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.453285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.453634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.454062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.454425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.454782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.455142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.455515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.455865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.456219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.456584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.456930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.457294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.457674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.458031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.458402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.458905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.459266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.459632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.460017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.461000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.461388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.461951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.462376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.462761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.463115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.463467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.463818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.464199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.464580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.464972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.465337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.465708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.466089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.466476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.466834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.467195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.467556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.467914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.468283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.468651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.469017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.469371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.469745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.470106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.470494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.470846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.471206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.471563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.471927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.472311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.472702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.473045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.473416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.474393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.474393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.474739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.474905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.475163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.475510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.475945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.476550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.476720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.477040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.477400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.478681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.479099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.479537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.480034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.480453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.480890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.481277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.481672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.482057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.482505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.482911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.483291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.483706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.484084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.484541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.484842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.485190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.485611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.486009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.486450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.486889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.487310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.487687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.488100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.488498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 03 03:32:56.488794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94249) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 03 03:32:56.531135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94249) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.711360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.context [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6211385-f358-428e-b9cb-f335d3904874(cell1) {{(pid=94250) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 03:32:56.718755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:32:56.720712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:32:56.721560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:32:56.723783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:32:56.747731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94250) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.760764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94250) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.793639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94250) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.819148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.context [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6211385-f358-428e-b9cb-f335d3904874(cell1) {{(pid=94249) load_cells /opt/stack/nova/nova/context.py:467}} Dec 03 03:32:56.827309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:32:56.829214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:32:56.830122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:32:56.832307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:32:56.861654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94249) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.864968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94249) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.898598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_db.sqlalchemy.engines [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94249) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 03 03:32:56.961687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading Gnome Dec 03 03:32:56.982948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading Google Dec 03 03:32:56.986297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading Windows (alt) Dec 03 03:32:56.991040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading file Dec 03 03:32:56.993010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading keyczar Dec 03 03:32:56.993648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading multi Dec 03 03:32:56.994550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Loading pyfs Dec 03 03:32:57.070921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading Gnome Dec 03 03:32:57.093118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading Google Dec 03 03:32:57.096697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading Windows (alt) Dec 03 03:32:57.102837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading file Dec 03 03:32:57.103990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading keyczar Dec 03 03:32:57.104455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading multi Dec 03 03:32:57.105392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO keyring.backend [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Loading pyfs Dec 03 03:32:57.284706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:32:57.292687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:32:57.408691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:32:57.417068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:32:57.626249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:32:57.632063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-b5b306df-d61a-4e7d-8243-68f83bad183b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:32:57.639173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55583a8549c0 pid: 94250 (default app) Dec 03 03:32:57.748591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 03 03:32:57.754395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WARNING keystonemiddleware.auth_token [None req-399b3dee-ee87-48de-b56e-7c0df478a367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 03 03:32:57.760863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55583a8549c0 pid: 94249 (default app) Dec 03 03:33:36.589177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ccbbc6ba-2c16-488b-998f-774cf6a1943a tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Action: 'create', calling method: .version_select at 0x7fe9174d8378>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1911339963", "metadata": {"Type": "work"}}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:36.693731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b663d96f-d50d-4e6b-98bd-256dbe0f930b tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Action: 'create', calling method: .version_select at 0x7fe9174d8378>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-804939175"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:38.318499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ccbbc6ba-2c16-488b-998f-774cf6a1943a tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.400991 Dec 03 03:33:38.320498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Dec 3 03:33:34 2020] POST /compute/v2.1/os-volumes => generated 353 bytes in 3405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 03 03:33:38.346868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6d519a29-eac8-4195-b757-e39356370297 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe9174d8b70>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:38.516503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b663d96f-d50d-4e6b-98bd-256dbe0f930b tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.449752 Dec 03 03:33:38.517170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1145 bytes} [Thu Dec 3 03:33:35 2020] POST /compute/v2.1/os-volumes => generated 344 bytes in 3452 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 03 03:33:38.540395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d66f4d0d-2cd0-4f06-b8ba-cd86432e325c tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174d8b70>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:38.660629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6d519a29-eac8-4195-b757-e39356370297 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 200 len: 353 microversion: 2.1 time: 0.331175 Dec 03 03:33:38.661627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:38 2020] GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 353 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:38.833493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d66f4d0d-2cd0-4f06-b8ba-cd86432e325c tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 200 len: 344 microversion: 2.1 time: 0.306875 Dec 03 03:33:38.836325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:38 2020] GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 344 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:33:39.689374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-56d3b190-aba3-48ce-b6d3-b2f114c19203 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe9174d8bf8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:39.857056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e8cac133-f7b7-436f-a707-a4816a0784f8 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174aebf8>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:39.876391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-56d3b190-aba3-48ce-b6d3-b2f114c19203 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 200 len: 354 microversion: 2.1 time: 0.206014 Dec 03 03:33:39.877286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:39 2020] GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:39.900064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ebf9047-2635-4ef3-8047-18a50e0241a6 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe9174afd90>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:40.089750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ebf9047-2635-4ef3-8047-18a50e0241a6 tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 200 len: 354 microversion: 2.1 time: 0.204386 Dec 03 03:33:40.090371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:39 2020] GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:33:40.118783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fd634de7-2671-45d5-b0c5-73c4ca84a8eb tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe9174aff28>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:40.130686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e8cac133-f7b7-436f-a707-a4816a0784f8 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 200 len: 345 microversion: 2.1 time: 0.287437 Dec 03 03:33:40.134772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:39 2020] GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:40.150008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-58eb0fce-f6d1-4e11-aae5-7c29367638a1 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Action: 'create', calling method: .version_select at 0x7fe9174aef28>, body: {"snapshot": {"volume_id": "588a58e6-468a-445c-bbdc-7f1d016bfb85", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1742921172"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:40.340101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fd634de7-2671-45d5-b0c5-73c4ca84a8eb tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 202 len: 0 microversion: 2.1 time: 0.233615 Dec 03 03:33:40.340824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:33:40 2020] DELETE /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:33:40.366602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a42b3ab1-7951-4390-95d2-fa8e7a8457ea tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe917455400>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:40.576965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a42b3ab1-7951-4390-95d2-fa8e7a8457ea tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 200 len: 353 microversion: 2.1 time: 0.230896 Dec 03 03:33:40.577757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 6/9] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:40 2020] GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:40.697485 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-58eb0fce-f6d1-4e11-aae5-7c29367638a1 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.557947 Dec 03 03:33:40.698076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 4/10] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Dec 3 03:33:40 2020] POST /compute/v2.1/os-snapshots => generated 287 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:33:40.715730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-efe9f3dd-3a65-4b77-9237-3a276f17b25a tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174afe18>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:40.874397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-efe9f3dd-3a65-4b77-9237-3a276f17b25a tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 287 microversion: 2.1 time: 0.169633 Dec 03 03:33:40.875106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 7/11] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:40 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:40.894206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f24e7675-2baf-455f-ba54-7bbfb5ca1159 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe91744c620>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:40.985573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f24e7675-2baf-455f-ba54-7bbfb5ca1159 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.103855 Dec 03 03:33:40.986169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 5/12] 10.222.0.66 () {58 vars in 1130 bytes} [Thu Dec 3 03:33:40 2020] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:41.009330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-80b87256-655a-4103-b4e4-af5aeb07440e tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174afa60>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:41.083982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-80b87256-655a-4103-b4e4-af5aeb07440e tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 287 microversion: 2.1 time: 0.089604 Dec 03 03:33:41.089327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:40 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:41.597405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef895900-6d21-483c-b893-69102bfc83be tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Calling method '.version_select at 0x7fe9174aef28>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:41.765881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-ef895900-6d21-483c-b893-69102bfc83be tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] HTTP exception thrown: Volume f8b58cf2-449f-4c4c-a25c-79503e089b9a could not be found. Dec 03 03:33:41.766589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef895900-6d21-483c-b893-69102bfc83be tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] Returning 404 to user: Volume f8b58cf2-449f-4c4c-a25c-79503e089b9a could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:33:41.767500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef895900-6d21-483c-b893-69102bfc83be tempest-VolumesGetTestJSON-484220489 tempest-VolumesGetTestJSON-484220489] 10.222.0.66 "GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a" status: 404 len: 109 microversion: 2.1 time: 0.181698 Dec 03 03:33:41.768092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 6/14] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:41 2020] GET /compute/v2.1/os-volumes/f8b58cf2-449f-4c4c-a25c-79503e089b9a => generated 109 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:33:42.105422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3584bcdb-446d-43da-b863-45e6c321ae6f tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe917385840>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:42.289739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3584bcdb-446d-43da-b863-45e6c321ae6f tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 287 microversion: 2.1 time: 0.196640 Dec 03 03:33:42.290617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 9/15] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:42 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:43.307976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5b5c5256-ce11-4bf4-aa18-aed1633a770a tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe917455510>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:43.468401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5b5c5256-ce11-4bf4-aa18-aed1633a770a tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 287 microversion: 2.1 time: 0.170664 Dec 03 03:33:43.469696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 10/16] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:43 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:43.841280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1937799095", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "1c43d707-8bed-4e9f-bc92-b1cbe807d330"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:44.055478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] validate_networks() for [('1c43d707-8bed-4e9f-bc92-b1cbe807d330', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:33:44.494578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4cc663de-ebc4-4144-9700-6bdbcd22dc40 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174d8bf8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:44.636195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4cc663de-ebc4-4144-9700-6bdbcd22dc40 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 288 microversion: 2.1 time: 0.157362 Dec 03 03:33:44.636814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 11/17] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:44 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 288 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:44.658094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ed7ecce7-e2d9-435c-b035-a036d82012bf tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174afbf8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:45.061624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ed7ecce7-e2d9-435c-b035-a036d82012bf tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 202 len: 0 microversion: 2.1 time: 0.417741 Dec 03 03:33:45.062752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 12/18] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Dec 3 03:33:44 2020] DELETE /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:33:45.084503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-21a0ad37-0f7f-46f2-813b-d77047a8db41 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174afe18>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:45.204711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-21a0ad37-0f7f-46f2-813b-d77047a8db41 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 200 len: 287 microversion: 2.1 time: 0.135333 Dec 03 03:33:45.205840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 13/19] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:45 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:46.230865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1967d8e5-1263-4f73-beee-1b0466006c49 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174551e0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:46.351090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-1967d8e5-1263-4f73-beee-1b0466006c49 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] HTTP exception thrown: Snapshot 47394edd-250c-453d-8c65-90718be37631 could not be found. Dec 03 03:33:46.352160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1967d8e5-1263-4f73-beee-1b0466006c49 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Returning 404 to user: Snapshot 47394edd-250c-453d-8c65-90718be37631 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:33:46.353451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1967d8e5-1263-4f73-beee-1b0466006c49 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631" status: 404 len: 111 microversion: 2.1 time: 0.139638 Dec 03 03:33:46.357575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 14/20] 10.222.0.66 () {58 vars in 1241 bytes} [Thu Dec 3 03:33:46 2020] GET /compute/v2.1/os-snapshots/47394edd-250c-453d-8c65-90718be37631 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:33:46.391544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e0af5bb6-1ef6-464a-a9a0-041bcc2ea4cd tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174d8bf8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:46.568453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e0af5bb6-1ef6-464a-a9a0-041bcc2ea4cd tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 202 len: 0 microversion: 2.1 time: 0.205071 Dec 03 03:33:46.577684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 15/21] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:33:46 2020] DELETE /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:33:46.612588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5fdf07e7-01f0-4775-86f5-34c04aa991c1 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe917455488>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:46.888343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5fdf07e7-01f0-4775-86f5-34c04aa991c1 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 200 len: 344 microversion: 2.1 time: 0.309002 Dec 03 03:33:46.888936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 16/22] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:46 2020] GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 344 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:33:47.605043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:33:47.606149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:33:47.611668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:33:47.612431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:33:47.613033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:33:47.637460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:47.642335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:47.643678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:47.646265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:47.718838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Getting quotas for project 8b36fc3f1d054f1597026e4eeed772c8. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:33:47.747291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Getting quotas for user 8b0f519b805249e99a56d339b4d55478 and project 8b36fc3f1d054f1597026e4eeed772c8. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:33:47.778592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:33:47.785252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:33:47.907288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d72f8442-057a-4a07-96fe-6be4329e79e2 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe917385840>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:47.997004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fad3dfbf-986d-4e9d-9d34-ea1e4bdef91d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.103146 Dec 03 03:33:47.998073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 7/23] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:33:42 2020] POST /compute/v2.1/servers => generated 380 bytes in 5105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:33:48.027669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-441f431e-f88e-4ba6-b3a8-8bf88172e4b7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:48.028139 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-441f431e-f88e-4ba6-b3a8-8bf88172e4b7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:48.090798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-d72f8442-057a-4a07-96fe-6be4329e79e2 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] HTTP exception thrown: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. Dec 03 03:33:48.091801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d72f8442-057a-4a07-96fe-6be4329e79e2 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Returning 404 to user: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:33:48.092974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d72f8442-057a-4a07-96fe-6be4329e79e2 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 404 len: 109 microversion: 2.1 time: 0.195853 Dec 03 03:33:48.093695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 17/24] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:47 2020] GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:33:48.141062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5b8527de-5fd8-40e6-9f95-166b65c494b4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe917455a60>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:48.354506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-5b8527de-5fd8-40e6-9f95-166b65c494b4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] HTTP exception thrown: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. Dec 03 03:33:48.355647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5b8527de-5fd8-40e6-9f95-166b65c494b4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Returning 404 to user: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:33:48.356642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5b8527de-5fd8-40e6-9f95-166b65c494b4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 404 len: 109 microversion: 2.1 time: 0.242929 Dec 03 03:33:48.357784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 18/25] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:33:48 2020] DELETE /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:33:48.377548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b26d9683-d730-44eb-91ae-c73b1a7cf1e4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Calling method '.version_select at 0x7fe9174afea0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:48.421622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-441f431e-f88e-4ba6-b3a8-8bf88172e4b7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:48.453063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-441f431e-f88e-4ba6-b3a8-8bf88172e4b7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1215 microversion: 2.1 time: 0.446832 Dec 03 03:33:48.453690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 8/26] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:48 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1215 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:33:48.569895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-b26d9683-d730-44eb-91ae-c73b1a7cf1e4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] HTTP exception thrown: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. Dec 03 03:33:48.570064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b26d9683-d730-44eb-91ae-c73b1a7cf1e4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] Returning 404 to user: Volume 588a58e6-468a-445c-bbdc-7f1d016bfb85 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:33:48.571018 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b26d9683-d730-44eb-91ae-c73b1a7cf1e4 tempest-VolumesSnapshotsTestJSON-2105154372 tempest-VolumesSnapshotsTestJSON-2105154372] 10.222.0.66 "GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85" status: 404 len: 109 microversion: 2.1 time: 0.208962 Dec 03 03:33:48.575014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 19/27] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:33:48 2020] GET /compute/v2.1/os-volumes/588a58e6-468a-445c-bbdc-7f1d016bfb85 => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:33:49.483726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-32396d7f-53d3-4300-8d4b-4065fb9e2992 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:49.486437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-32396d7f-53d3-4300-8d4b-4065fb9e2992 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:49.738693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-32396d7f-53d3-4300-8d4b-4065fb9e2992 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:49.780223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-32396d7f-53d3-4300-8d4b-4065fb9e2992 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1215 microversion: 2.1 time: 0.311692 Dec 03 03:33:49.789163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 9/28] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:49 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:33:50.804228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-026b8dd5-bef5-4d96-a549-02e8d7d7a99a tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:50.805454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-026b8dd5-bef5-4d96-a549-02e8d7d7a99a tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:50.908916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: .version_select at 0x7fe9174d8bf8>, body: {"keypair": {"name": "tempest-keypair-730451375"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:51.100617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-026b8dd5-bef5-4d96-a549-02e8d7d7a99a tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:51.107370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:33:51.122481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:33:51.131575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-026b8dd5-bef5-4d96-a549-02e8d7d7a99a tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1215 microversion: 2.1 time: 0.337497 Dec 03 03:33:51.138351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 10/29] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:50 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:33:52.161556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:52.163101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:52.190974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:52.191488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:52.192350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:52.192985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:52.420834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:33:52.425975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:33:52.445387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-45818d86-d1b2-45a3-9474-e25eddcb8f10 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 2.142868 Dec 03 03:33:52.453400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 20/30] 10.222.0.66 () {62 vars in 1189 bytes} [Thu Dec 3 03:33:50 2020] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 2152 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 03 03:33:52.543179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:52.593516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-88a23715-fe11-4bed-8cf1-2101ab626175 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1211 microversion: 2.1 time: 0.436419 Dec 03 03:33:52.597056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 11/31] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:52 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1211 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:33:53.618167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:53.635586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:53.663047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:53.663633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:53.664500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:53.664992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:54.156391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:54.191710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-87c18a00-d20e-4c15-8015-b06ef3ab1038 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1273 microversion: 2.1 time: 0.582708 Dec 03 03:33:54.194590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 21/32] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:53 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1273 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:33:55.221245 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:55.221847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:55.261943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:55.262706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:55.265372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:55.266040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:55.281199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: .version_select at 0x7fe916a6abf8>, body: {"keypair": {"name": "tempest-keypair-117980616"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:33:55.432239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:33:55.460007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:33:56.214612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:33:56.242302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:33:56.293723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-854add55-eca6-408d-aa3e-4ef90528e4f5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.023615 Dec 03 03:33:56.302778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 12/33] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Dec 3 03:33:54 2020] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:33:57.090165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:57.124354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7f84073b-48b0-4af9-a184-d578257a1c50 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 1.916760 Dec 03 03:33:57.129550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 22/34] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:55 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:33:58.159296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:33:58.161233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:33:58.213932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:58.215757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:58.219262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:33:58.222209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:33:59.716215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:33:59.743857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-324fc6ae-be26-4028-a540-5d725dc43293 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 1.599992 Dec 03 03:33:59.748630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 13/35] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:33:58 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:00.778192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:00.778923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:00.799833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:00.803888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:00.807635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:00.810393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:03.105640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:03.142143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27827f5c-eaca-438c-8563-ed1d172fbaca tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 2.379196 Dec 03 03:34:03.149651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 23/36] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:00 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:04.180930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:04.190584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:04.217429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:04.220835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:04.222100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:04.223784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:07.132702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:07.148558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8bed3b7e-b93a-409b-b31f-bae1093681c7 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 2.982619 Dec 03 03:34:07.149147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 14/37] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:04 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 2984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:08.171776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:08.172450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:08.192496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:08.193712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:08.194516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:08.195007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:08.328924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1326394736", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cb459e0-39d6-47ca-bdde-353dad2c0705"}], "security_groups": [{"name": "tempest-securitygroup--1014498154"}], "key_name": "tempest-keypair-117980616", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:08.722469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] validate_networks() for [('7cb459e0-39d6-47ca-bdde-353dad2c0705', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:34:08.831578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:08.854539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f30ea3e9-27b3-4f37-9e29-f19df691c657 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 0.692324 Dec 03 03:34:08.855132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 24/38] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:08 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:09.278761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-09e415d2-a4c0-4ecb-b413-871801e36ce4 req-402dd271-ad7d-4d4e-ae0d-b5a8ba205a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aa867d-e29c-4db2-9dfe-139883b0f26c", "tag": "1bcb6c41-8968-482d-8c02-c522a1f249ed"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:09.298736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:09.298736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:09.315216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-09e415d2-a4c0-4ecb-b413-871801e36ce4 req-402dd271-ad7d-4d4e-ae0d-b5a8ba205a2c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:09.316016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-09e415d2-a4c0-4ecb-b413-871801e36ce4 req-402dd271-ad7d-4d4e-ae0d-b5a8ba205a2c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:09.339781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-09e415d2-a4c0-4ecb-b413-871801e36ce4 req-402dd271-ad7d-4d4e-ae0d-b5a8ba205a2c service nova] Creating event network-changed:1bcb6c41-8968-482d-8c02-c522a1f249ed for instance d4aa867d-e29c-4db2-9dfe-139883b0f26c on hv-cinder-74915 Dec 03 03:34:09.340751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-09e415d2-a4c0-4ecb-b413-871801e36ce4 req-402dd271-ad7d-4d4e-ae0d-b5a8ba205a2c service nova] Acquired lock "compute-rpcapi-router" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:34:09.342176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:09.342931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:09.344429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:09.345148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:09.359907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.compute.rpcapi [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 03 03:34:09.361530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] Releasing lock "compute-rpcapi-router" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:34:09.428707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-09d7ae7f-5616-481e-96f7-9ee3cffe19bf None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571203 Dec 03 03:34:09.429369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 25/39] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:08 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:09.445359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-733793341", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29e6beb-dbdd-4360-87a0-1178c03113fb"}], "security_groups": [{"name": "tempest-securitygroup--251537663"}], "key_name": "tempest-keypair-730451375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:09.825152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] validate_networks() for [('e29e6beb-dbdd-4360-87a0-1178c03113fb', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:34:10.346523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:34:10.346993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:34:10.347499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:34:10.348080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:34:10.348536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:34:10.362084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:10.363195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:10.364461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:10.366828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:10.388209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:34:10.392780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:34:10.414727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:34:10.415370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:34:10.508027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2440b985-5c77-48f4-bb9e-cade115892a8 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.194330 Dec 03 03:34:10.512074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 15/40] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:34:08 2020] POST /compute/v2.1/servers => generated 402 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:34:10.526788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:10.533279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:10.551302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:10.552674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:10.553568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:10.554062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:11.103577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:11.127404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1a690937-0fa3-4fe1-8626-347ad89a6232 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 0.613873 Dec 03 03:34:11.129990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 16/41] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:10 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:11.156325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bf50d011-89ed-4161-930e-8886b127da28 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:11.158588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bf50d011-89ed-4161-930e-8886b127da28 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:11.385859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf50d011-89ed-4161-930e-8886b127da28 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:11.409589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bf50d011-89ed-4161-930e-8886b127da28 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1237 microversion: 2.1 time: 0.272965 Dec 03 03:34:11.411198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 17/42] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:11 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1237 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:12.154971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:12.155938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:12.169563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:12.170064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:12.170954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:12.171380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:13.132807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:13.159195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e94f826b-3063-4e61-889b-50a34da09d5d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 1.015620 Dec 03 03:34:13.159790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 18/43] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:12 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:13.227105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:13.227798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:13.228966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:34:13.229600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:34:13.230508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:34:13.231113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:34:13.232504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:34:13.250285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:13.254390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:13.256425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:13.259642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:13.260002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:13.262887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:13.267966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:13.268658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:13.309045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:34:13.322585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:34:13.348800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:34:13.363528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:34:13.486753 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:13.496253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2e3957eb-93b1-47bd-8227-258e26996ecf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.064339 Dec 03 03:34:13.497160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 26/44] 10.222.0.66 () {62 vars in 1178 bytes} [Thu Dec 3 03:34:09 2020] POST /compute/v2.1/servers => generated 401 bytes in 4067 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 03 03:34:13.503959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-13fc8a23-1ea7-4302-a95e-65ebf30d3c66 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1295 microversion: 2.1 time: 0.338081 Dec 03 03:34:13.504750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 19/45] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:13 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1295 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:13.523979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:13.524885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:13.669291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:13.696801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:13.712077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:13.715574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-72b87796-f441-4447-a19a-9deaa5ee2e20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1280 microversion: 2.20 time: 0.209791 Dec 03 03:34:13.717665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 27/46] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:13 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:34:14.186595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:14.188282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:14.202059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.203015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:14.204101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.205166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:14.530191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:14.531472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:14.541682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.542481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:14.543478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.544083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:14.826329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:14.852477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d842c942-639c-491c-9dea-2d6a9751148c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 0.679047 Dec 03 03:34:14.853381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 20/47] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:14 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:14.894414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:14.895096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:14.903148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.903788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:14.904631 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:14.905118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:15.289658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:15.316675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:15.325222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:15.326628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e9d31bc1-fdb8-4ae8-abb0-11005c2ba743 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1332 microversion: 2.20 time: 0.452721 Dec 03 03:34:15.328045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 21/48] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:14 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1332 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:15.348599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:15.363871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9d7460f0-b44c-460d-bad4-f33401830301 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.844857 Dec 03 03:34:15.367060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 28/49] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:14 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:15.881131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:15.884103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:15.902732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:15.903388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:15.904229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:15.904717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:15.987955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f601866f-15db-4ab4-a98c-4eb080372a05 req-295236e5-ca89-4293-b11d-7e7095c8a38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa867d-e29c-4db2-9dfe-139883b0f26c", "name": "network-vif-plugged", "status": "completed", "tag": "1bcb6c41-8968-482d-8c02-c522a1f249ed"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:16.016724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:16.016724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:16.362609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f601866f-15db-4ab4-a98c-4eb080372a05 req-295236e5-ca89-4293-b11d-7e7095c8a38b service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.363151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f601866f-15db-4ab4-a98c-4eb080372a05 req-295236e5-ca89-4293-b11d-7e7095c8a38b service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.398649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f601866f-15db-4ab4-a98c-4eb080372a05 req-295236e5-ca89-4293-b11d-7e7095c8a38b service nova] Creating event network-vif-plugged:1bcb6c41-8968-482d-8c02-c522a1f249ed for instance d4aa867d-e29c-4db2-9dfe-139883b0f26c on hv-cinder-74915 Dec 03 03:34:16.402204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f601866f-15db-4ab4-a98c-4eb080372a05 req-295236e5-ca89-4293-b11d-7e7095c8a38b service nova] Acquired lock "compute-rpcapi-router" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:34:16.403746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.404577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.405598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.406296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.417334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.compute.rpcapi [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 03 03:34:16.418655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] Releasing lock "compute-rpcapi-router" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:34:16.471710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e01c7566-adb5-4d7e-88a0-410ff649921f None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.141613 Dec 03 03:34:16.473174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 22/50] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:15 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:16.495790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:16.500700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:16.517965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.518755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.519872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.525969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:16.528096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.554068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7477268c-255d-4be0-9a75-205fdb42eae1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 0.686744 Dec 03 03:34:16.559490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 29/51] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:15 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:16.587460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:16.601338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:16.619338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.626654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.627742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:16.629687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:16.915133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:16.961309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:16.980708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:16.984675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8ea9adad-7820-4f3a-a06d-5ef80de36630 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1338 microversion: 2.20 time: 0.506772 Dec 03 03:34:16.985311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 23/52] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:16 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1338 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:17.589987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:17.590709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:17.607047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:17.607728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:17.610858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:17.611711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:18.609452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:18.625293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-048cfa2c-faf0-4eff-a569-75357990d80e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 2.064607 Dec 03 03:34:18.627671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 30/53] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:16 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:18.659504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:18.660191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:18.689564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:18.690049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:18.699561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:18.700074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:19.388456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:19.414743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c43cce0f-e1d4-40fa-acb6-ed60093dcdbf tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 1.830369 Dec 03 03:34:19.415425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 24/54] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:17 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:19.587273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-8192b3dd-4cc6-4f77-9755-ad4c74549b04 req-de61e4db-5f53-410f-957b-1387252a65f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac04b0b-7889-4479-916f-167720d1c630", "tag": "d8950c69-c9f3-48de-8cdb-3a898103e0ea"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:19.594206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:19.611792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:19.611792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:19.617534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:19.625057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:19.626268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dc9e294f-8e99-4b0e-b724-338fe9316771 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.983414 Dec 03 03:34:19.626932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 31/55] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:18 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:19.629854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8192b3dd-4cc6-4f77-9755-ad4c74549b04 req-de61e4db-5f53-410f-957b-1387252a65f9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:19.631627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8192b3dd-4cc6-4f77-9755-ad4c74549b04 req-de61e4db-5f53-410f-957b-1387252a65f9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:19.653587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:19.654574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:19.668655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:19.670953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:19.678545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:19.679169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:19.697403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-8192b3dd-4cc6-4f77-9755-ad4c74549b04 req-de61e4db-5f53-410f-957b-1387252a65f9 service nova] Creating event network-changed:d8950c69-c9f3-48de-8cdb-3a898103e0ea for instance 8ac04b0b-7889-4479-916f-167720d1c630 on hv-cinder-74915 Dec 03 03:34:19.715500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-8192b3dd-4cc6-4f77-9755-ad4c74549b04 req-de61e4db-5f53-410f-957b-1387252a65f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143053 Dec 03 03:34:19.717985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 25/56] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:19 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:34:20.442989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:20.449437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:20.469703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:20.470787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:20.471965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:20.472734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:21.054561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:21.072192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bff54a2f-1ae7-4b08-a422-35124dd886e6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 1.428616 Dec 03 03:34:21.092090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 32/57] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:19 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:21.107105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:21.112580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:21.128821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:21.133002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:21.134160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:21.135503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:21.819019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:21.827768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b5fd0aad-4ed7-4f8d-8316-e5a5eed47f5f tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1315 microversion: 2.1 time: 1.397761 Dec 03 03:34:21.828569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 26/58] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:20 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1315 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:22.009734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-a6f6c701-cf40-4226-896e-ec1f917eb35a req-bf389d46-44ac-4d29-90a1-db176b1e2e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:22.029514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:22.029514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:22.041167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:22.049910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a6f6c701-cf40-4226-896e-ec1f917eb35a req-bf389d46-44ac-4d29-90a1-db176b1e2e36 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:22.050472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a6f6c701-cf40-4226-896e-ec1f917eb35a req-bf389d46-44ac-4d29-90a1-db176b1e2e36 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:22.061624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:22.073413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-a6f6c701-cf40-4226-896e-ec1f917eb35a req-bf389d46-44ac-4d29-90a1-db176b1e2e36 service nova] Creating event network-changed:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:34:22.078642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-a6f6c701-cf40-4226-896e-ec1f917eb35a req-bf389d46-44ac-4d29-90a1-db176b1e2e36 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238860 Dec 03 03:34:22.079585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 27/59] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:22.087888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:22.089910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6c9a6d81-041b-4bd4-9b2b-7507e239a455 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.996230 Dec 03 03:34:22.090871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 33/60] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:21 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:22.106710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:22.107760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:22.119353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:22.120008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:22.121501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:22.122130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:22.385543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:22.403832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-aa0bd9d6-7986-4908-b3b7-51aaee8569a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.310180 Dec 03 03:34:22.410663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 28/61] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:22 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:22.857479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:22.858411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:22.872122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:22.872852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:22.873893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:22.874665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:23.123881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:23.124540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:23.142890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:23.143674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:23.144677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:23.147389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:23.387303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:23.407090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a836f61c-4521-4dd0-afe4-8608a09698d0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1502 microversion: 2.1 time: 0.565271 Dec 03 03:34:23.408273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 34/62] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:22 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1502 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:23.430197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:23.430897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:23.460494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:23.460927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:23.461786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:23.462297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:23.525810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:23.566638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:23.607234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:23.614158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9da49d11-a320-4265-9028-c3c216fa0d2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.497518 Dec 03 03:34:23.617981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 29/63] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:23 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:23.806591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:23.834541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e285f11d-e6ab-472d-8372-982554356e59 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.410245 Dec 03 03:34:23.835223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 35/64] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:23 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:24.643710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:24.644965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:24.657081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:24.657853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:24.659343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:24.660328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:24.867754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:24.868436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:24.877534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:24.878048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:24.878935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:24.879430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:25.123318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:25.162574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:25.189915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:25.194386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d5a00b78-2ff6-4f21-bdb7-67f0b709e41a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.560970 Dec 03 03:34:25.200248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 30/65] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:24 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:25.575459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:25.593856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-05c445ab-e035-4dac-a050-e2421ecfda2e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.744595 Dec 03 03:34:25.598329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 36/66] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:24 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:26.226787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:26.231047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:26.249300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.250160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.251243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.251921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.322066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2f7fd06-5555-4db9-98d8-f0509bac0e86"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:26.323329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:26.331176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.331871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.332858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.334209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.573227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:26.591082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:26.598570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:26.601018 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-db20c300-780e-433f-8c2d-c9d548f43d78 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.385787 Dec 03 03:34:26.602801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 31/67] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:26 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:26.626708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:26.627808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:26.649257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.649835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.650664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:26.651150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:26.919907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:26.930049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0b57afb7-06ed-4642-a35e-eb53a49cc8c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.322832 Dec 03 03:34:26.930988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 32/68] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:26 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:27.219223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8bc83644-3c63-4800-be13-a617edccefcd tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "POST /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907100 Dec 03 03:34:27.220714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 37/69] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:34:26 2020] POST /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:27.627505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:27.628189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:27.637561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:27.638058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:27.639134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:27.639632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:27.903168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:27.920165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:27.930077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:27.931471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-371ff047-9081-489a-b963-fe6f95393bf9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.314014 Dec 03 03:34:27.938224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 33/70] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:27 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:27.957595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:27.958450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:27.967552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:27.968062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:27.968911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:27.969402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:28.243846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:28.252914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5fb17620-dc90-45d7-b252-713edc79c321 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.308304 Dec 03 03:34:28.262838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 38/71] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:27 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:28.270295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c7fb5604-8ad3-4a66-b74a-f3f9d42964c0 req-79dbafd4-0c41-4309-bbe9-c60cb7bb7632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac04b0b-7889-4479-916f-167720d1c630", "name": "network-vif-plugged", "status": "completed", "tag": "d8950c69-c9f3-48de-8cdb-3a898103e0ea"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:28.278799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:28.278799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:28.288197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c7fb5604-8ad3-4a66-b74a-f3f9d42964c0 req-79dbafd4-0c41-4309-bbe9-c60cb7bb7632 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:28.288696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c7fb5604-8ad3-4a66-b74a-f3f9d42964c0 req-79dbafd4-0c41-4309-bbe9-c60cb7bb7632 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:28.307462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c7fb5604-8ad3-4a66-b74a-f3f9d42964c0 req-79dbafd4-0c41-4309-bbe9-c60cb7bb7632 service nova] Creating event network-vif-plugged:d8950c69-c9f3-48de-8cdb-3a898103e0ea for instance 8ac04b0b-7889-4479-916f-167720d1c630 on hv-cinder-74915 Dec 03 03:34:28.312746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c7fb5604-8ad3-4a66-b74a-f3f9d42964c0 req-79dbafd4-0c41-4309-bbe9-c60cb7bb7632 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053887 Dec 03 03:34:28.313815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 34/72] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:28 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:34:28.957880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:28.958920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:28.967136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:28.967747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:28.968876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:28.969436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:29.241104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:29.273588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:29.279718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:29.281136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:29.293010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:29.293752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:29.294281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:29.295195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:29.295571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b88c9b85-d1d9-46c6-b908-1dfd19c04ed0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.347172 Dec 03 03:34:29.296079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:29.296450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 39/73] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:28 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:29.579314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:29.589141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-db025049-9c86-4a6e-a19c-c18e6dcc53ca tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1363 microversion: 2.1 time: 0.321199 Dec 03 03:34:29.589756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 35/74] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:29 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:30.320251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:30.321023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:30.329427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:30.329918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:30.330772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:30.331257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:30.358793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-3d93ed46-4bc0-4c5d-bc58-acf0dbff5339 req-9a18de5e-3234-4d9f-ab62-f838864661da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "name": "network-vif-plugged", "status": "completed", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:30.365929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:30.365929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:30.375619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3d93ed46-4bc0-4c5d-bc58-acf0dbff5339 req-9a18de5e-3234-4d9f-ab62-f838864661da service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:30.376345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3d93ed46-4bc0-4c5d-bc58-acf0dbff5339 req-9a18de5e-3234-4d9f-ab62-f838864661da service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:30.398371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-3d93ed46-4bc0-4c5d-bc58-acf0dbff5339 req-9a18de5e-3234-4d9f-ab62-f838864661da service nova] Creating event network-vif-plugged:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:34:30.403745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-3d93ed46-4bc0-4c5d-bc58-acf0dbff5339 req-9a18de5e-3234-4d9f-ab62-f838864661da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054705 Dec 03 03:34:30.404589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 36/75] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:30 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:34:30.588800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:30.609605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:30.619117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:30.620499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c942ef69-ff27-404d-aabe-d6fd9fe3ac80 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.309863 Dec 03 03:34:30.621279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 40/76] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:30 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:30.632034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:30.637341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:30.646194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:30.647077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:30.647912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:30.648412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:30.965818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:30.975626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0089f88a-c706-4c71-8fe4-5ac42d5988c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1550 microversion: 2.1 time: 0.371832 Dec 03 03:34:30.987570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 37/77] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:30 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1550 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:31.010005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:31.011357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:31.024429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:31.025318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:31.026368 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:31.027035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:31.221067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-16861f53-421e-4875-a467-22f53c9eeece tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222501 Dec 03 03:34:31.222197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 41/78] 10.222.0.66 () {58 vars in 1265 bytes} [Thu Dec 3 03:34:30 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:31.648729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:31.649612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:31.657649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:31.658161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:31.659044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:31.659575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:32.275752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:32.326980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:32.350519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:32.359832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d7a2a014-4d49-4913-bc64-1c305c60d7f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1405 microversion: 2.20 time: 0.720691 Dec 03 03:34:32.363800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 38/79] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:31 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1405 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:33.385890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:33.390836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:33.410530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:33.413409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:33.415844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:33.419564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:33.996019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:33.998155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:34.027833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:34.028346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:34.029204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:34.031343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:34.167550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:34.204134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:34.211327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:34.222270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c9c359bb-990c-4bc2-ba98-fa8f96a55e62 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1596 microversion: 2.20 time: 0.846700 Dec 03 03:34:34.223041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 42/80] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:34:33 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1596 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:34:34.225380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3afff48f-9e00-40f8-8037-7d54385f5728 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.240087 Dec 03 03:34:34.228909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 39/81] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:33 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:34.246421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-b0a762ee-19b4-4964-96fe-2037bd6730be req-e5f44614-2b95-48d1-ab14-ccc096fc6462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac04b0b-7889-4479-916f-167720d1c630", "tag": "d8950c69-c9f3-48de-8cdb-3a898103e0ea"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:34.257487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:34.263031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:34.267972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:34.267972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:34.278524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-b0a762ee-19b4-4964-96fe-2037bd6730be req-e5f44614-2b95-48d1-ab14-ccc096fc6462 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:34.279451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-b0a762ee-19b4-4964-96fe-2037bd6730be req-e5f44614-2b95-48d1-ab14-ccc096fc6462 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:34.300666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:34.301880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:34.303801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:34.304646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:34.313028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-b0a762ee-19b4-4964-96fe-2037bd6730be req-e5f44614-2b95-48d1-ab14-ccc096fc6462 service nova] Creating event network-changed:d8950c69-c9f3-48de-8cdb-3a898103e0ea for instance 8ac04b0b-7889-4479-916f-167720d1c630 on hv-cinder-74915 Dec 03 03:34:34.329620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-b0a762ee-19b4-4964-96fe-2037bd6730be req-e5f44614-2b95-48d1-ab14-ccc096fc6462 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099447 Dec 03 03:34:34.330429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 43/82] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:34 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:34.581219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef87ebfe-5eb0-4e9f-8361-910e9ec08a2b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.338132 Dec 03 03:34:34.585531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 40/83] 10.222.0.66 () {60 vars in 1306 bytes} [Thu Dec 3 03:34:34 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:34:35.257023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:35.258293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:35.268860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:35.282088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:35.283713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:35.286886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:35.506868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f3dcda9-5a91-4b77-92fc-c98aa4e85364 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.273823 Dec 03 03:34:35.510787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 44/84] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:35 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:36.530507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:36.532223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:36.552026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:36.552874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:36.554149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:36.554856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:36.837349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8659b72d-9ab8-4670-a65a-72e2bed75908 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.322965 Dec 03 03:34:36.838382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 41/85] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:36 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:37.332953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:37.338002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:37.353859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.357352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:37.361187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.361785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:37.461212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:34:37.677724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4c1326a1-d0e2-4de1-94e2-32406ac6e8d8 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "DELETE /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 204 len: 0 microversion: 2.1 time: 0.353824 Dec 03 03:34:37.678831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 45/86] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:34:37 2020] DELETE /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:34:37.695576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:37.696361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:37.714449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.718499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:37.719550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.720049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:37.855740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:37.856879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:37.867701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.869547 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:37.874280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:37.874954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:38.056010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-22e59084-a97f-4d12-8b0e-d61e40681e50 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.210556 Dec 03 03:34:38.056835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 46/87] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:37 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 03:34:38.203381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:38.224149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-82683c71-9134-4433-a40a-77554e6e51ed tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1554 microversion: 2.1 time: 0.539441 Dec 03 03:34:38.238733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 42/88] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:37 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1554 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:38.393560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:38.394747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:38.396302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-cf00b690-7a5a-4d85-bcb1-7c28a567da14 req-f812a824-7929-42a4-ac66-abb6b6e6c738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:38.409534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:38.409534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:38.434289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-cf00b690-7a5a-4d85-bcb1-7c28a567da14 req-f812a824-7929-42a4-ac66-abb6b6e6c738 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:38.435381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:38.435904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:38.436613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-cf00b690-7a5a-4d85-bcb1-7c28a567da14 req-f812a824-7929-42a4-ac66-abb6b6e6c738 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:38.436738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:38.437238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:38.517942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-cf00b690-7a5a-4d85-bcb1-7c28a567da14 req-f812a824-7929-42a4-ac66-abb6b6e6c738 service nova] Creating event network-changed:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:34:38.537468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-cf00b690-7a5a-4d85-bcb1-7c28a567da14 req-f812a824-7929-42a4-ac66-abb6b6e6c738 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146601 Dec 03 03:34:38.540926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 43/89] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:38 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:34:38.691620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e12eae1b-4fd8-4a47-8cb4-253ef3cddb1c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.308364 Dec 03 03:34:38.693246 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 47/90] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:38 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:39.075323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:39.086318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:39.102147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.104698 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:39.105775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.108976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:39.251929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:39.259105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:39.275793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.280630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:39.281839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.282553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:39.377938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f0c9975-9cf7-4b45-8931-d4e4ca8e1fe7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.313754 Dec 03 03:34:39.382015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 44/91] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:39 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:39.724556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:39.729909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:39.751778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.752293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:39.753142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:39.753628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:40.071339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8716cd41-46eb-41a1-b512-016f6fad2b3e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.368942 Dec 03 03:34:40.072398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 45/92] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:39 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:40.077455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:40.093001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27a69f16-48ee-48dc-abec-4fb00573fcc5 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1554 microversion: 2.1 time: 0.850896 Dec 03 03:34:40.094605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 48/93] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:39 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1554 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:40.400426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:40.401862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:40.416331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:40.417048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:40.418097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:40.419714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:40.615073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3dedb09e-d9d2-4c83-85a7-476eb121e1f2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.225941 Dec 03 03:34:40.616170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 46/94] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:40 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:41.096740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:41.097916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:41.124359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:41.129048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:41.137034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.140388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.146665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.146665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.163237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.171124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.174038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.191068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.453265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4e2b5485-267e-4e62-b260-e4ef094900a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.373694 Dec 03 03:34:41.457533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 49/95] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:41 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:41.478206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-5c302c9f-1931-427b-ac03-42d5950ff7d4 req-edb67b8e-59d4-44ad-9779-dc6ecc49080e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa867d-e29c-4db2-9dfe-139883b0f26c", "name": "network-vif-unplugged", "status": "completed", "tag": "1bcb6c41-8968-482d-8c02-c522a1f249ed"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:41.494595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:41.494595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:41.513671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5c302c9f-1931-427b-ac03-42d5950ff7d4 req-edb67b8e-59d4-44ad-9779-dc6ecc49080e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.521997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5c302c9f-1931-427b-ac03-42d5950ff7d4 req-edb67b8e-59d4-44ad-9779-dc6ecc49080e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.568591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-5c302c9f-1931-427b-ac03-42d5950ff7d4 req-edb67b8e-59d4-44ad-9779-dc6ecc49080e service nova] Creating event network-vif-unplugged:1bcb6c41-8968-482d-8c02-c522a1f249ed for instance d4aa867d-e29c-4db2-9dfe-139883b0f26c on hv-cinder-74915 Dec 03 03:34:41.598177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-5c302c9f-1931-427b-ac03-42d5950ff7d4 req-edb67b8e-59d4-44ad-9779-dc6ecc49080e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135587 Dec 03 03:34:41.600704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 50/96] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:41 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:41.634644 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:41.636408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:41.646746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.647643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.647909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:41.648983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:41.649978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:41.670102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-90ac7a3d-f125-4264-9b46-125e7278fcd0 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1554 microversion: 2.1 time: 0.561493 Dec 03 03:34:41.680850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 47/97] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:41 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1554 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:41.838431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9a8ed27a-ce84-40f1-a148-7c9ec50f0afe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.214871 Dec 03 03:34:41.839378 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 51/98] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:41 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:34:42.470092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:42.472790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:42.493138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.495234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:42.496297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.500323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:42.698527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:42.700216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-852d0480-ec35-4261-a03d-a76d4139df41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.238908 Dec 03 03:34:42.703529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 48/99] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:42 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:42.704883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:42.722206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.722722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:42.728932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.732053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:42.860247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:42.861394 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:42.883446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.884161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:42.885739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:42.886440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:43.052984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fb40988e-faf8-4179-8109-6c43a642bed4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 14 microversion: 2.1 time: 0.206968 Dec 03 03:34:43.056527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 49/100] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:42 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 03:34:43.085075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:43.104173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-05be3466-ba01-4e79-aef4-0f54fadcc7d1 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1554 microversion: 2.1 time: 0.419479 Dec 03 03:34:43.106284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 52/101] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:42 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:43.396237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f6d6d05c-9513-4e3d-aa35-1ac5c69be710 req-4c26e4bd-5464-4e48-a2c5-acd555241cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa867d-e29c-4db2-9dfe-139883b0f26c", "name": "network-vif-deleted", "tag": "1bcb6c41-8968-482d-8c02-c522a1f249ed"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:43.407312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:34:43.407312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:34:43.422087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f6d6d05c-9513-4e3d-aa35-1ac5c69be710 req-4c26e4bd-5464-4e48-a2c5-acd555241cc4 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:43.422649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f6d6d05c-9513-4e3d-aa35-1ac5c69be710 req-4c26e4bd-5464-4e48-a2c5-acd555241cc4 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:43.458729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f6d6d05c-9513-4e3d-aa35-1ac5c69be710 req-4c26e4bd-5464-4e48-a2c5-acd555241cc4 service nova] Creating event network-vif-deleted:1bcb6c41-8968-482d-8c02-c522a1f249ed for instance d4aa867d-e29c-4db2-9dfe-139883b0f26c on hv-cinder-74915 Dec 03 03:34:43.464135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f6d6d05c-9513-4e3d-aa35-1ac5c69be710 req-4c26e4bd-5464-4e48-a2c5-acd555241cc4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082031 Dec 03 03:34:43.467161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 50/102] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:34:43 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:34:43.718853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:43.720556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:43.732455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:43.733480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:43.734723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:43.735416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:43.910205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9d8b32a1-982f-4ebb-a853-fbaff8f27500 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.202283 Dec 03 03:34:43.912130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 53/103] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:43 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:44.075898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:44.077040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:44.107153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.107656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.108819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.109642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.132366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:44.133154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:44.169999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.171898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.199998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.200498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.346609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.347612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.348165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lazy-loading 'fault' on Instance uuid d4aa867d-e29c-4db2-9dfe-139883b0f26c {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:34:44.423442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:44.437970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cc9ee208-8e18-406b-9c7c-74d1a2fd8cf2 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1351 microversion: 2.1 time: 0.314498 Dec 03 03:34:44.437970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 54/104] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:44 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1351 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:44.932782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:44.934863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:44.947419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.948112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:44.949587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:44.950289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:46.931508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ad76009-80fa-461c-b17a-f31b512b256d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 18663 microversion: 2.1 time: 2.869654 Dec 03 03:34:46.932737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 51/105] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:44 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 18663 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:46.944638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:46.945406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:46.953676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:46.954189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:46.955068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:46.955553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:46.963599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7236fb43-60a9-4c4c-be8f-28ffc4ec50d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 2.044809 Dec 03 03:34:46.967023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 55/106] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:44 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:34:47.036394 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:47.037346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:47.038039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lazy-loading 'fault' on Instance uuid d4aa867d-e29c-4db2-9dfe-139883b0f26c {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:34:47.114975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b0f519b805249e99a56d339b4d55478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b36fc3f1d054f1597026e4eeed772c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:34:47.126667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64064a8a-78e7-4ade-b5e2-006b79a3205d tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 200 len: 1351 microversion: 2.1 time: 0.192113 Dec 03 03:34:47.137363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 52/107] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:46 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:47.955468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:47.955468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:47.981428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:47.982692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:47.984708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:47.988197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:47.989708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:47.990268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:47.993988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:47.994549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:47.995410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:47.995911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:48.157647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b280b927-85c3-427e-a88a-b7a7a33c2685 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 19342 microversion: 2.1 time: 0.216372 Dec 03 03:34:48.158403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 56/108] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:47 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 19342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:48.169739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:48.170770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:48.183187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-01f3cd20-4719-4c48-ab59-927cc0cfdd1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 14 microversion: 2.20 time: 0.211617 Dec 03 03:34:48.184171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 53/109] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:47 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:34:48.194936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:48.195449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:48.205971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:48.206527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:48.269662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] HTTP exception thrown: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. Dec 03 03:34:48.270566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Returning 404 to user: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:34:48.271540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d2de92b-5eb2-4ce2-9e69-6a82d364b778 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 404 len: 111 microversion: 2.1 time: 0.111786 Dec 03 03:34:48.272121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 57/110] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:48 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:34:49.204344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:49.213842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:49.215672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:49.216977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:49.251297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:49.251846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:49.252766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:49.253886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:49.255394 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:49.255863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:49.257589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:49.259773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:49.425941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4d4e8759-74b7-4316-978a-5872602e27ac tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 22217 microversion: 2.1 time: 0.260020 Dec 03 03:34:49.430755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 54/111] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:49 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 22217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:49.498939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fd842fa9-f43e-4c14-98f3-605e46c907ef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 11454 microversion: 2.20 time: 0.307102 Dec 03 03:34:49.503258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 58/112] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:49 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 11454 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:50.371900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:50.373543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:50.383647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.384316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.385974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.386668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.456969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:50.464128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] HTTP exception thrown: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. Dec 03 03:34:50.466114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:50.470828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Returning 404 to user: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:34:50.471833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3c0f025e-1e39-47e2-a546-aef39a8cf96c tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "DELETE /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 404 len: 111 microversion: 2.1 time: 0.111502 Dec 03 03:34:50.472453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 55/113] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:34:50 2020] DELETE /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:34:50.489548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.490173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.496334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.496864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.516650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:34:50.516650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] [instance: d4aa867d-e29c-4db2-9dfe-139883b0f26c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:50.534406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.534925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.535819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.537598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.648828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] HTTP exception thrown: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. Dec 03 03:34:50.651558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] Returning 404 to user: Instance d4aa867d-e29c-4db2-9dfe-139883b0f26c could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:34:50.667151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8d14ab09-1317-4f07-ad8d-4cfe553bcc35 tempest-DeleteServersTestJSON-1117799821 tempest-DeleteServersTestJSON-1117799821] 10.222.0.66 "GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c" status: 404 len: 111 microversion: 2.1 time: 0.188879 Dec 03 03:34:50.667838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 56/114] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:34:50 2020] GET /compute/v2.1/servers/d4aa867d-e29c-4db2-9dfe-139883b0f26c => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:34:50.686508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-04af4ccc-0925-4ac6-bbf5-f3f396f58c8b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 23902 microversion: 2.1 time: 0.251226 Dec 03 03:34:50.686667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:50.687590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 59/115] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:50 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 23902 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:50.698893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:50.712192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.712712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.713679 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:50.714361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:50.878069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b80dc300-66b9-4644-8244-d0c937d19ffb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 18356 microversion: 2.20 time: 0.208855 Dec 03 03:34:50.880328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 57/116] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:50 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 18356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:51.704992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:51.706848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:51.725720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:51.726648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:51.727716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:51.728395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:51.876692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-85822575-9e20-4d5c-b2df-d6a521eba6e5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 25173 microversion: 2.1 time: 0.181358 Dec 03 03:34:51.877362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 60/117] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:51 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 25173 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:51.898851 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:51.899997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:51.937125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:51.937646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:51.938496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:51.943521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:52.172910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8dfaad30-9db3-4b5f-88fc-5fa638998a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 19342 microversion: 2.20 time: 0.284115 Dec 03 03:34:52.174108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 58/118] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:51 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 19342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:52.902795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:52.907118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:52.926788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:52.928715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:52.932046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:52.934376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:53.151743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b4f6e484-953c-40eb-b6f7-fce762792601 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 26764 microversion: 2.1 time: 0.265636 Dec 03 03:34:53.156387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 61/119] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:52 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 26764 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:53.196590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:53.201044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:53.212369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:53.213123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:53.214306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:53.214857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:53.368885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-362d3879-c90f-45a3-918d-06ff98ab01dc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 22540 microversion: 2.20 time: 0.184346 Dec 03 03:34:53.375411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 59/120] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:53 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 22540 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:54.171978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:54.173926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:54.201266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:54.202365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:54.203440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:54.205867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:54.395754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:54.402658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:54.415148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:54.415872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:54.416536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a2f1367e-4f8d-4c6d-95f5-e25573f5f91c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 27756 microversion: 2.1 time: 0.255927 Dec 03 03:34:54.417177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:54.417651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 62/121] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:54 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 27756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:54.418331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:54.604235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7272c161-0129-482c-ac0a-58beb88147b5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 23797 microversion: 2.20 time: 0.220221 Dec 03 03:34:54.605721 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 60/122] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:54 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 23797 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:55.434673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:55.436824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:55.448790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:55.449446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:55.450628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:55.451254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:55.615145 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-baa6643c-fb4c-414a-b973-ddb44cb40a23 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28227 microversion: 2.1 time: 0.189768 Dec 03 03:34:55.616976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 63/123] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:55 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28227 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:55.623553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:55.624702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:55.633728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:55.634214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:55.635290 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:55.636025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:55.784228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8885f3c1-f291-43cb-a971-2f90fa23cc65 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 25483 microversion: 2.20 time: 0.170907 Dec 03 03:34:55.785481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 61/124] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:55 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 25483 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:56.639979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:56.642005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:56.659216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:56.661873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:56.662914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:56.665007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:56.805516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:56.806705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:56.831967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:56.833064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:56.834104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:56.836649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:56.842228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d8ebff1d-e41d-477d-b396-4aebca58d298 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28227 microversion: 2.1 time: 0.217499 Dec 03 03:34:56.843634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 64/125] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:56 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28227 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:57.013296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-03428364-e130-4e9d-8fa1-b0242f0673a5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 26950 microversion: 2.20 time: 0.219925 Dec 03 03:34:57.014016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 62/126] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:56 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 26950 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:57.862800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:57.863998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:57.880766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:57.881296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:57.882132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:57.886281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:58.041294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:58.045278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:58.059351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:58.060224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:58.062442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:58.063237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:58.088942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dfc10d6c-c23c-4387-be44-ff9ec4984070 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28355 microversion: 2.1 time: 0.236194 Dec 03 03:34:58.089751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 65/127] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:57 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28355 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:34:58.226457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f7416adb-afa8-4e73-9494-997001e16d0b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 27562 microversion: 2.20 time: 0.202632 Dec 03 03:34:58.230918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 63/128] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:58 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 27562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:34:59.109900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:59.111365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:59.123442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:59.124287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:59.125749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:59.126900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:59.251518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:34:59.252953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:34:59.270738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:59.271730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:34:59.272773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:34:59.273266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:01.791655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-424cb2e4-66e5-4f3c-ae11-b545fc5fa0e7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28518 microversion: 2.1 time: 2.694459 Dec 03 03:35:01.792750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 66/129] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:34:59 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28518 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:35:01.834492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9ee4e169-6f3a-42f2-89ef-f5ae1e2fddb8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28216 microversion: 2.20 time: 2.598001 Dec 03 03:35:01.835401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 64/130] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:34:59 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28216 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:02.828726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:02.829929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:02.842864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:02.843824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:02.844813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:02.845441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:02.859544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:02.863190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:02.889122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:02.890416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:02.893891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:02.896705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:03.008882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-698b5c74-c7b4-4002-aaf2-369f314e83dc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28686 microversion: 2.1 time: 0.208959 Dec 03 03:35:03.014014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 67/131] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:02 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28686 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:03.092135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ec28fd1d-f1e0-444c-b53b-b18eb6069888 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28216 microversion: 2.20 time: 0.249482 Dec 03 03:35:03.096250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 65/132] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:02 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:35:04.039331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:04.041034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:04.057591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:04.061408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:04.063792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:04.065777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:04.112848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:04.115729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:04.138615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:04.139210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:04.146282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:04.146919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:04.320975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-520430ba-88e2-42d3-9642-e330690c0df6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28686 microversion: 2.1 time: 0.303179 Dec 03 03:35:04.322067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 68/133] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:04 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28686 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:04.413273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6244e669-53aa-4e8e-85a4-8d2784368ddc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28506 microversion: 2.20 time: 0.311064 Dec 03 03:35:04.414095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 66/134] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:04 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:05.345730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:05.354564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:05.369844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:05.371229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:05.372815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:05.379423 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:05.434160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:05.441251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:05.484427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:05.485311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:05.486499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:05.492033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:05.680754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ab8ef31b-5e73-421f-b5dc-fef6c6ac9875 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 28686 microversion: 2.1 time: 0.350316 Dec 03 03:35:05.681452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 69/135] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:05 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 28686 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:05.749855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dfadc66e-aad4-4dcc-a932-7e02308089fa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28672 microversion: 2.20 time: 0.326779 Dec 03 03:35:05.751177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 67/136] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:05 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28672 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:35:06.710596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:06.718541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:06.763791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:06.764511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:06.765519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:06.766316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:06.789677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:06.797218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:06.813335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:06.817466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:06.822755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:06.836604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:07.029054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-35e29b34-8ca0-4165-bf7a-ce266c56402f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 29514 microversion: 2.1 time: 0.339532 Dec 03 03:35:07.030009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 70/137] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:06 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 29514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:07.117703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-adf1cc2b-14c6-4f79-b969-e02cf39fbcdf tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28672 microversion: 2.20 time: 0.357502 Dec 03 03:35:07.119197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 68/138] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:06 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:35:08.048672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:08.052460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:08.073073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:08.075099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:08.077278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:08.078810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:08.147302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:08.148877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:08.164314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:08.165215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:08.166395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:08.169401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:08.303194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64768475-f51b-441f-a747-5ea0566d4a9d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 31514 microversion: 2.1 time: 0.264154 Dec 03 03:35:08.304092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 71/139] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:08 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 31514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:08.369760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f6b0441c-672c-4089-9dbe-967985e3c1b0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28672 microversion: 2.20 time: 0.243903 Dec 03 03:35:08.371083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 69/140] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:08 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:35:09.324605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:09.326399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:09.354596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:09.355103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:09.356562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:09.357065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:09.443560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:09.445295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:09.483192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:09.483994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:09.485198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:09.485832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:09.731039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a7b8e2c3-2c1a-4667-a971-9c6d28079c48 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 33078 microversion: 2.1 time: 0.418309 Dec 03 03:35:09.732108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 72/141] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:09 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 33078 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:09.745866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2dc0cb63-6968-41ba-b0d2-d9866129aff0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 28704 microversion: 2.20 time: 0.339101 Dec 03 03:35:09.747915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 70/142] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:09 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 28704 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:09.752233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-872471429", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "160bc4c0-2e8b-4454-bcf7-456486062213"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:09.882965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] validate_networks() for [('160bc4c0-2e8b-4454-bcf7-456486062213', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:35:10.755009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:10.757900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:10.779591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:10.783251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:10.788204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:10.788896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:11.025831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-193024da-977f-4ea1-b969-99602b23d72a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 33872 microversion: 2.1 time: 0.285279 Dec 03 03:35:11.026364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 71/143] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:10 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 33872 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:35:11.425738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1055168567", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c035356-c912-4076-b2c1-33f3ed9a39e4"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:11.538916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] validate_networks() for [('2c035356-c912-4076-b2c1-33f3ed9a39e4', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:35:11.720638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:35:11.721196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:35:11.721819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:35:11.722597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:35:11.723230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:35:11.736354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:11.737882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:11.740626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:11.741309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:11.795829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Getting quotas for project 7762d1a9afb04c66b6ced204aeaffe45. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:11.808314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Getting quotas for user 90d1d1034ade43fbabdbc00bed671409 and project 7762d1a9afb04c66b6ced204aeaffe45. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:11.826907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:35:11.834369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:35:11.899583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3540f77c-0072-453f-8c33-9eadc8e7d4c8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165927 Dec 03 03:35:11.901072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 73/144] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:35:09 2020] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:35:11.918068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:11.919598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:11.947301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:11.948041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:11.949084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:11.949763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:12.204991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-49229a25-b82f-47af-8314-a892eba30aed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 32486 microversion: 2.20 time: 0.300530 Dec 03 03:35:12.205208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 74/145] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:11 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 32486 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:12.234448 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2f33d88a-2b1c-46bf-bc44-27465b7452c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:12.235725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2f33d88a-2b1c-46bf-bc44-27465b7452c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:12.474820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2f33d88a-2b1c-46bf-bc44-27465b7452c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:12.495940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2f33d88a-2b1c-46bf-bc44-27465b7452c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1213 microversion: 2.1 time: 0.284815 Dec 03 03:35:12.497298 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 75/146] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:12 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:12.521372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:12.522453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:12.533635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:12.533635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:12.534062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:12.534791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:12.726665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4ebe614a-6aa8-4ace-a3e1-7da1fdb778ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 35283 microversion: 2.1 time: 0.215546 Dec 03 03:35:12.731993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 76/147] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:12 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 35283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:13.228419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:13.230455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:13.261688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.265818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.270404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.271085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.495820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-76011f30-cd70-46da-b0ed-85059b47eeac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 33544 microversion: 2.20 time: 0.281789 Dec 03 03:35:13.496524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 77/148] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:13 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 33544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:13.534362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:13.536174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:13.547036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.547791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.549826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.563053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.906176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:35:13.906674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:35:13.907214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:35:13.907671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:35:13.908126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:35:13.922477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.922975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.923843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:13.924326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:13.963823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:13.982521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1170626a-0721-40c7-a112-90f7f21a5a59 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1273 microversion: 2.1 time: 0.469866 Dec 03 03:35:13.985835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 78/149] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:13 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1273 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:14.007449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Getting quotas for project 386b3100fc3542508eb392d2e70ddbba. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:14.009517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:14.011638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:14.022898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Getting quotas for user d31f066eec84417bb9f41ad1b00710ea and project 386b3100fc3542508eb392d2e70ddbba. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:14.037127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:14.038329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:14.039989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:14.046010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:14.059874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:35:14.070977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:35:14.228369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-014c202c-9b93-4a80-a44a-99bc6d1c80e6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.200394 Dec 03 03:35:14.229058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 72/150] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:35:11 2020] POST /compute/v2.1/servers => generated 383 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:35:14.275041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2678727a-f863-4852-8b58-f18f16013e24 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:14.275740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2678727a-f863-4852-8b58-f18f16013e24 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:14.640217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2678727a-f863-4852-8b58-f18f16013e24 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:14.659176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2678727a-f863-4852-8b58-f18f16013e24 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1222 microversion: 2.1 time: 0.423301 Dec 03 03:35:14.660824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 73/151] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:14 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:14.725332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:14.742115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:14.779158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:14.780075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:14.783628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:14.785595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:17.111799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-95b1e848-63fd-4397-adfc-f2030d4fb9eb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 38216 microversion: 2.1 time: 3.124111 Dec 03 03:35:17.116027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 79/152] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:13 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 38216 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:17.134169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1199330825", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c035356-c912-4076-b2c1-33f3ed9a39e4"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:17.142328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4a7322b7-76f2-415b-846d-f288015ed336 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 36920 microversion: 2.20 time: 2.440638 Dec 03 03:35:17.143467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 74/153] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:14 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 36920 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:17.167867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:17.168559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:17.205525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:17.212074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:17.214761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:17.215651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:17.299410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] validate_networks() for [('2c035356-c912-4076-b2c1-33f3ed9a39e4', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:35:19.600494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:19.614464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fe66954e-405a-4564-821e-d979190a2692 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 2.469491 Dec 03 03:35:19.615164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 75/154] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:17 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:19.626648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:19.627770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:19.639413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:19.640024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:19.640957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:19.641516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:19.920785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:35:19.921271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:35:19.921812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:35:19.922277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:35:19.922712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:35:19.955918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:19.957347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:19.958501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:19.959220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:19.982038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Getting quotas for project 386b3100fc3542508eb392d2e70ddbba. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:19.986922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Getting quotas for user d31f066eec84417bb9f41ad1b00710ea and project 386b3100fc3542508eb392d2e70ddbba. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:20.003975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:35:20.007014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:35:20.084919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b67a5d94-932a-4dce-9d9f-081be0f717ae tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.966943 Dec 03 03:35:20.086432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 80/155] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:35:17 2020] POST /compute/v2.1/servers => generated 383 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:35:20.098202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:20.099655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:20.109202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:20.109976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:20.111035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:20.111689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:22.437689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-06a009b7-f22d-4399-ae97-bf3f53d31c77 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 200 len: 38347 microversion: 2.1 time: 2.820695 Dec 03 03:35:22.444645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 76/156] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:19 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 38347 bytes in 2829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:22.457249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c6542e51-bca3-4ea0-9dec-10123c5bd340 req-56b3aa44-3af8-461d-9565-f612fe7d6d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5a9bcc-4417-4079-8a92-1b9aa8f531e8", "tag": "bb265466-9212-4a05-89d0-2946dfba813b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:22.485560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:22.485560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:22.514690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c6542e51-bca3-4ea0-9dec-10123c5bd340 req-56b3aa44-3af8-461d-9565-f612fe7d6d48 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:22.515480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c6542e51-bca3-4ea0-9dec-10123c5bd340 req-56b3aa44-3af8-461d-9565-f612fe7d6d48 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:22.524788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-74d29954-df6b-4d0f-830a-6c237b9551a3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 38218 microversion: 2.20 time: 2.436601 Dec 03 03:35:22.526375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 81/157] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:20 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 38218 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:22.557151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:22.561363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:22.583327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c6542e51-bca3-4ea0-9dec-10123c5bd340 req-56b3aa44-3af8-461d-9565-f612fe7d6d48 service nova] Creating event network-changed:bb265466-9212-4a05-89d0-2946dfba813b for instance 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 on hv-cinder-74915 Dec 03 03:35:22.590367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:22.590892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:22.591743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:22.593863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c6542e51-bca3-4ea0-9dec-10123c5bd340 req-56b3aa44-3af8-461d-9565-f612fe7d6d48 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147241 Dec 03 03:35:22.594570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 77/158] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:22 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:22.595182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:22.622108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:22.623320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:22.658933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:22.660442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:22.661845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:22.662655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.196908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:23.222600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9bb19be7-a457-4ad7-a7a8-81a8de562e32 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1218 microversion: 2.1 time: 0.694038 Dec 03 03:35:23.230801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 82/159] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:22 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1218 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:23.267089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:23.267868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:23.282695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.283369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.284970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.287613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.455726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-462239f3-8839-484b-937f-9cd23c8ce4fe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/ips" status: 200 len: 147 microversion: 2.1 time: 0.221600 Dec 03 03:35:23.460636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 83/160] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:35:23 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/ips => generated 147 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:23.544809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:23.551116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:23.568587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.570425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.574513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.575247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.827845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-459e8400-8690-4f3d-a6c1-1eccd3058bfd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 200 len: 38359 microversion: 2.20 time: 0.294248 Dec 03 03:35:23.830467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 84/161] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:23 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 38359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:23.906306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:23.913585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:23.950919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.953390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:23.954407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:23.956902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:24.163704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-20d71c7d-9fbe-4970-a072-f72cfc9c1d36 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/ips" status: 200 len: 150 microversion: 2.20 time: 0.327256 Dec 03 03:35:24.164667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 85/162] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Dec 3 03:35:23 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/ips => generated 150 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:35:24.258710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:24.263806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:24.279411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:24.284615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:24.286453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:24.287178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:24.315177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:24.338828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2c7387b9-b065-4a63-8fc3-cf38f3561d1c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 1.738684 Dec 03 03:35:24.353742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 78/163] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:22 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:24.628833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:24.641833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c952f36f-be6a-4a75-88d3-28d238e86112 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1280 microversion: 2.1 time: 0.397202 Dec 03 03:35:24.642493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 86/164] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:24 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1280 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:25.364593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:25.365488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:25.373846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:25.374661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:25.375721 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:25.376412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:25.668885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:25.670257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:25.689614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:25.696492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:25.697580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:25.698229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:25.959728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:25.970262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7ec244b0-b448-431b-b41e-7e5d9343e4cf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1280 microversion: 2.1 time: 0.314137 Dec 03 03:35:25.976170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 87/165] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:25 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:26.543356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:26.561272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-19447d0b-68f2-4467-9c4e-dc08bedc157f tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 1.206631 Dec 03 03:35:26.562892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 79/166] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:25 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:26.993647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:26.994359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:27.003254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:27.004051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:27.005097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:27.005592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:27.337742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:27.348326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7b0ece3-d5d1-48e0-ab5a-3423850b5944 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1280 microversion: 2.1 time: 0.363916 Dec 03 03:35:27.358606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 88/167] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:26 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1280 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:27.585176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-1ae007cc-263f-4755-8f05-06034ba12087 req-d63ae94e-cdb2-484c-970a-f52e43ac7eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2846e1b1-6107-4523-a287-f599394f984f", "tag": "74dbb841-a018-4b62-93d8-e752de7fcf69"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:27.587180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:27.587968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:27.594430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:27.594430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:27.597227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:27.599253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:27.600683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:27.601411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:27.610222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-1ae007cc-263f-4755-8f05-06034ba12087 req-d63ae94e-cdb2-484c-970a-f52e43ac7eb5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:27.610746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-1ae007cc-263f-4755-8f05-06034ba12087 req-d63ae94e-cdb2-484c-970a-f52e43ac7eb5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:27.632029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-1ae007cc-263f-4755-8f05-06034ba12087 req-d63ae94e-cdb2-484c-970a-f52e43ac7eb5 service nova] Creating event network-changed:74dbb841-a018-4b62-93d8-e752de7fcf69 for instance 2846e1b1-6107-4523-a287-f599394f984f on hv-cinder-74915 Dec 03 03:35:27.637944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-1ae007cc-263f-4755-8f05-06034ba12087 req-d63ae94e-cdb2-484c-970a-f52e43ac7eb5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069162 Dec 03 03:35:27.639096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 80/168] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:27 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:28.371871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:28.376162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:28.385160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:28.385787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:28.386895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:28.388080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:28.809099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:28.821906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c08cb150-848b-4fb0-b547-7a9b75d99c81 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 1.244305 Dec 03 03:35:28.829204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 89/169] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:27 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:29.852922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:29.856415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:29.866469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:29.867181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:29.868834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:29.869541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:30.224340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:30.251638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fb176bf8-4c86-4c2b-a209-b2fb4cf0ac67 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 1.889815 Dec 03 03:35:30.252942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 81/170] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:28 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:30.301228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8d2d64-188f-435d-a6ee-f59ec5e66c39"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:30.302585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:30.312076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:30.312569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:30.313697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:30.314197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:30.740217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:30.761065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b6e18e25-0a38-4d0d-b487-15ba61c17d09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 0.924181 Dec 03 03:35:30.763260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 90/171] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:29 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:31.277005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:31.280223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:31.298469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:31.298979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:31.300479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:31.301032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:31.382838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-aedbaa33-cc2f-4d17-97af-ae5e18f5787c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.092111 Dec 03 03:35:31.384510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 82/172] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:35:30 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-volume_attachments => generated 194 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:31.667154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-46af56c2-ad6b-4039-bd05-78f3993fa696 req-e2b4d953-82e3-4bb9-bfe0-b867a90b45f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a9bcc-4417-4079-8a92-1b9aa8f531e8", "name": "network-vif-plugged", "status": "completed", "tag": "bb265466-9212-4a05-89d0-2946dfba813b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:31.675107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:31.675107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:31.705213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-46af56c2-ad6b-4039-bd05-78f3993fa696 req-e2b4d953-82e3-4bb9-bfe0-b867a90b45f7 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:31.705965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-46af56c2-ad6b-4039-bd05-78f3993fa696 req-e2b4d953-82e3-4bb9-bfe0-b867a90b45f7 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:31.727576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-46af56c2-ad6b-4039-bd05-78f3993fa696 req-e2b4d953-82e3-4bb9-bfe0-b867a90b45f7 service nova] Creating event network-vif-plugged:bb265466-9212-4a05-89d0-2946dfba813b for instance 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 on hv-cinder-74915 Dec 03 03:35:31.736379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-46af56c2-ad6b-4039-bd05-78f3993fa696 req-e2b4d953-82e3-4bb9-bfe0-b867a90b45f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086756 Dec 03 03:35:31.738194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 83/173] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:35:31.790894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:31.791672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:31.801191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:31.801706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:31.802618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:31.803118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:32.278802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:32.290292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6240ce1a-38aa-438d-899f-8f3ce3abc237 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 1.024791 Dec 03 03:35:32.291221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 91/174] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:31 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:32.304123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:32.305027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:32.314323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:32.315904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:32.316958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:32.318841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:32.416671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lazy-loading 'flavor' on Instance uuid 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:35:33.042684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:33.076661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a9a67449-4ac8-482f-808c-efffae7312c3 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1313 microversion: 2.1 time: 1.286957 Dec 03 03:35:33.077347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 84/175] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:31 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1313 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:33.104493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-8caad5cb-ce7f-40a0-baf6-a8b27625cb46 req-a98d6429-4325-4691-b16c-2cc8ca6d3d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9955eb83-6d7f-4770-a851-4c648eda7deb", "tag": "8da2ef35-41d3-42dc-8daf-5e6b3c260f36"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:33.113374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:33.113374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:33.149678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8caad5cb-ce7f-40a0-baf6-a8b27625cb46 req-a98d6429-4325-4691-b16c-2cc8ca6d3d6f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:33.151352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8caad5cb-ce7f-40a0-baf6-a8b27625cb46 req-a98d6429-4325-4691-b16c-2cc8ca6d3d6f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:33.213837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-8caad5cb-ce7f-40a0-baf6-a8b27625cb46 req-a98d6429-4325-4691-b16c-2cc8ca6d3d6f service nova] Creating event network-changed:8da2ef35-41d3-42dc-8daf-5e6b3c260f36 for instance 9955eb83-6d7f-4770-a851-4c648eda7deb on hv-cinder-74915 Dec 03 03:35:33.244142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-8caad5cb-ce7f-40a0-baf6-a8b27625cb46 req-a98d6429-4325-4691-b16c-2cc8ca6d3d6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157634 Dec 03 03:35:33.248381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-12548916-2331-401a-8c17-5b733802365f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 202 len: 0 microversion: 2.20 time: 0.955559 Dec 03 03:35:33.254654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 85/176] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:33 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:33.258415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 92/177] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:35:32 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:35:33.294126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:33.306454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:33.318190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:33.327339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:33.355489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:33.356028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:33.357083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:33.357584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:33.359158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:33.362884 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:33.366964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:33.370969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:34.472504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:34.480493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:34.504865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-88934dfd-b91d-418a-98ed-0830f57d33b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 1.197680 Dec 03 03:35:34.505506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 93/178] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:33 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:34.512798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:34.529839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:34.530508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:34.539369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:34.547610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bf1248b5-f689-48e2-8274-e428f0746f5b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 1.286873 Dec 03 03:35:34.554386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:34.556904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:34.557983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:34.560652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:34.561000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 86/179] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:33 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:35.179920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:35.203602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bb8b578e-84e4-47d9-807c-1a1d2cc59cc5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1497 microversion: 2.1 time: 0.682960 Dec 03 03:35:35.205037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 94/180] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:34 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1497 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:35.533396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:35.536269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:35.557758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:35.560402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:35.561465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:35.566277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:35.577947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:35.578576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:35.597926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:35.598502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:35.599390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:35.608454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:36.054832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:36.075712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e5181da4-1fde-461d-a635-32aec658658c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.555450 Dec 03 03:35:36.076987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 87/181] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:35 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:36.135416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:36.151867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:36.159804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:36.161095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bf162fb1-4836-4899-bb3e-57163f5143ac tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.597215 Dec 03 03:35:36.168592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 95/182] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:35 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:36.901278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: .version_select at 0x7fe91abf58c8>, body: {"keypair": {"name": "tempest-TestShelveInstance-1839724600"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:36.953838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:36.960030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for user 408d9f0256a6410bb861e24242e13f24 and project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:37.100536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:37.101515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:37.107270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:37.110811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:37.111414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:37.112873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:37.113750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:37.114780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for user 408d9f0256a6410bb861e24242e13f24 and project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:37.130447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f534b5f0-7c96-4c52-9e66-94edf68f9b7c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.504015 Dec 03 03:35:37.131298 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 88/183] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Dec 3 03:35:36 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:37.149763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-29a34ad4-cc4e-47fe-988a-62e85ba24412 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: .version_select at 0x7fe915752a60>, body: {"security_group": {"name": "tempest-TestShelveInstance-1140165042", "description": "tempest-TestShelveInstance-1140165042 description"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:37.437736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:37.447617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0d8b7170-1e17-47cc-8bae-4e375854f1d4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.357531 Dec 03 03:35:37.448330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 96/184] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:37 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:37.458876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-ef9f384e-0c4d-43e6-b253-4d16227d6ebc req-9d6ec945-5c8e-4e65-a8fa-8cb576b8cb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846e1b1-6107-4523-a287-f599394f984f", "name": "network-vif-plugged", "status": "completed", "tag": "74dbb841-a018-4b62-93d8-e752de7fcf69"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:37.465697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:37.465697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:37.475473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ef9f384e-0c4d-43e6-b253-4d16227d6ebc req-9d6ec945-5c8e-4e65-a8fa-8cb576b8cb08 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:37.475978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ef9f384e-0c4d-43e6-b253-4d16227d6ebc req-9d6ec945-5c8e-4e65-a8fa-8cb576b8cb08 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:37.495238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-ef9f384e-0c4d-43e6-b253-4d16227d6ebc req-9d6ec945-5c8e-4e65-a8fa-8cb576b8cb08 service nova] Creating event network-vif-plugged:74dbb841-a018-4b62-93d8-e752de7fcf69 for instance 2846e1b1-6107-4523-a287-f599394f984f on hv-cinder-74915 Dec 03 03:35:37.500227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-ef9f384e-0c4d-43e6-b253-4d16227d6ebc req-9d6ec945-5c8e-4e65-a8fa-8cb576b8cb08 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050499 Dec 03 03:35:37.501026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 97/185] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:37 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:37.511761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:37.512542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:37.521012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:37.521523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:37.522404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:37.522903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:37.535715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-29a34ad4-cc4e-47fe-988a-62e85ba24412 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.397407 Dec 03 03:35:37.536569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 89/186] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Dec 3 03:35:37 2020] POST /compute/v2.1/os-security-groups => generated 245 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:37.554588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b3c3c7aa-e3a9-4de3-b8d4-c981974db06c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: .version_select at 0x7fe915752b70>, body: {"security_group_rule": {"parent_group_id": "828afee8-3795-4747-9cb4-ad2a6ebe0ed5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:37.847878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:37.864839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:37.871706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:37.872944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-026de119-5bf1-470e-ae8b-2ca3a2b9dde6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.370938 Dec 03 03:35:37.873537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 98/187] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:37 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:37.907645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b3c3c7aa-e3a9-4de3-b8d4-c981974db06c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.363205 Dec 03 03:35:37.908325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 90/188] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:35:37 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:35:37.925315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d712183a-f1fd-45b7-aa86-dc544f6f02d8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: .version_select at 0x7fe916a6c840>, body: {"security_group_rule": {"parent_group_id": "828afee8-3795-4747-9cb4-ad2a6ebe0ed5", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:38.188923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d712183a-f1fd-45b7-aa86-dc544f6f02d8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.272830 Dec 03 03:35:38.189353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 99/189] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:35:37 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:38.472108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:38.472924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:38.482181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:38.482878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:38.483726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:38.484225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:38.879401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:38.898286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:38.902079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:38.902518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ea6552d2-041d-489a-b05b-6acd527225db tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.441217 Dec 03 03:35:38.908742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 91/190] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:38 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:38.942837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:38.947399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:38.951626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:38.952345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:39.522184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:39.538702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:39.545226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:39.546538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a12f55b8-0991-42c2-83b4-38e031e5c7f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.658562 Dec 03 03:35:39.547109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 100/191] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:38 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:39.942653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:39.943398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:39.970535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:39.971960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:39.973034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:39.973904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:40.025248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:40.025797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:40.036201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:40.036936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:40.037956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:40.038672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:40.240479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:35:40.515776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-15617678-2ea3-4860-980f-ffd33e4fa7be tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "DELETE /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 204 len: 0 microversion: 2.1 time: 0.501568 Dec 03 03:35:40.516619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 101/192] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:35:40 2020] DELETE /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:35:40.539346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:40.541950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:40.562729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:40.564111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:40.566951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:40.569281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:41.421570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:41.444265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-866ebce8-7633-4554-9997-4e7036641712 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 1.521038 Dec 03 03:35:41.444901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 92/193] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:39 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:41.466686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:41.467473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:41.496225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:41.497605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:41.498706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:41.499397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:41.526316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:41.541876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-43815dd8-d664-42ba-aced-728314f61095 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1503 microversion: 2.1 time: 1.019824 Dec 03 03:35:41.542512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 102/194] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:40 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1503 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:41.570093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d28f8dcb-de6e-4dda-978d-58417dc329d6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:41.591017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d28f8dcb-de6e-4dda-978d-58417dc329d6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:41.591538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d28f8dcb-de6e-4dda-978d-58417dc329d6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:41.707234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d28f8dcb-de6e-4dda-978d-58417dc329d6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Going to try to stop instance {{(pid=94250) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 03 03:35:41.811713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d28f8dcb-de6e-4dda-978d-58417dc329d6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 202 len: 0 microversion: 2.1 time: 0.262121 Dec 03 03:35:41.812822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 103/195] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:41 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:35:41.839233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:41.840385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:41.857001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:41.858190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:41.859339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:41.860033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:42.245184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:42.269318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:42.286353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:42.298481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:42.300676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0e26c804-966f-4649-8b9d-b9f2f704ae86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.482352 Dec 03 03:35:42.300979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0836c1fb-bf31-4a96-8525-223100ff93be tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.854227 Dec 03 03:35:42.304015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 104/196] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:41 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:42.312953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 93/197] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:41 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:42.470609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:42.476585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:42.500403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:42.503202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:42.507275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:42.508560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:42.575946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:42.585156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:42.609978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:42.612440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:42.614354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:42.615543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:43.132766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:43.146299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f595a323-da2f-44dc-a959-754f4b7f100c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.687827 Dec 03 03:35:43.148418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 105/198] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:42 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:43.208433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:43.223532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-857809cc-e200-4dc3-a27e-0192ca96c72e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1503 microversion: 2.1 time: 0.666027 Dec 03 03:35:43.228771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 94/199] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:42 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1503 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:43.325038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:43.327074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:43.338125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:43.342841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:43.347305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:43.348960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:43.350129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:43.350852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:43.362364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:43.365168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:43.366370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:43.367222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:45.074442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:45.076013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:45.100223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e25dc8fd-5b8f-4b1f-a04a-9606f69716b9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 1.784217 Dec 03 03:35:45.106875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 106/200] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:43 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:45.112594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:45.123174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:45.128855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f927d14c-7759-478e-a999-0c45bc05d447 req-72614c98-dd2e-4f1b-aca0-58b0d996d33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9955eb83-6d7f-4770-a851-4c648eda7deb", "name": "network-vif-plugged", "status": "completed", "tag": "8da2ef35-41d3-42dc-8daf-5e6b3c260f36"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:45.137032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-20c1504c-675f-48d9-bc04-fdda22bc3b1b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 1.808613 Dec 03 03:35:45.137846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 95/201] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:43 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:45.161034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:45.161034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:45.173224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:45.176308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:45.193972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f927d14c-7759-478e-a999-0c45bc05d447 req-72614c98-dd2e-4f1b-aca0-58b0d996d33a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:45.204752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f927d14c-7759-478e-a999-0c45bc05d447 req-72614c98-dd2e-4f1b-aca0-58b0d996d33a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:45.241790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:45.242316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:45.243357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:45.243850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:45.536495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f927d14c-7759-478e-a999-0c45bc05d447 req-72614c98-dd2e-4f1b-aca0-58b0d996d33a service nova] Creating event network-vif-plugged:8da2ef35-41d3-42dc-8daf-5e6b3c260f36 for instance 9955eb83-6d7f-4770-a851-4c648eda7deb on hv-cinder-74915 Dec 03 03:35:45.545754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f927d14c-7759-478e-a999-0c45bc05d447 req-72614c98-dd2e-4f1b-aca0-58b0d996d33a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436313 Dec 03 03:35:45.549396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 107/202] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:45 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:45.572683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:45.573380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:45.602841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:45.603344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:45.604752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:45.605253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.108004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.127030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.154674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-af2ea32a-e1a6-4abc-a5dd-bc43fb10cd44 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.988077 Dec 03 03:35:46.157978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-02f2c984-2dff-454a-9138-a426f3238d10 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1461 microversion: 2.1 time: 0.605464 Dec 03 03:35:46.159420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 96/203] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:45 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:46.168369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 108/204] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:45 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1461 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:46.216723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-9aea64c6-d56e-41a0-b5c7-8b9241c35f3e req-26dbf3fe-50d0-457f-b6fd-89af40e31436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a9bcc-4417-4079-8a92-1b9aa8f531e8", "name": "network-vif-deleted", "tag": "bb265466-9212-4a05-89d0-2946dfba813b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:46.221508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:46.231229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:46.244674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:46.244674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:46.259654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:46.264582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.265653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:46.267541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.270041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9aea64c6-d56e-41a0-b5c7-8b9241c35f3e req-26dbf3fe-50d0-457f-b6fd-89af40e31436 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:46.279249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9aea64c6-d56e-41a0-b5c7-8b9241c35f3e req-26dbf3fe-50d0-457f-b6fd-89af40e31436 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.351269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-9aea64c6-d56e-41a0-b5c7-8b9241c35f3e req-26dbf3fe-50d0-457f-b6fd-89af40e31436 service nova] Creating event network-vif-deleted:bb265466-9212-4a05-89d0-2946dfba813b for instance 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 on hv-cinder-74915 Dec 03 03:35:46.389021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-9aea64c6-d56e-41a0-b5c7-8b9241c35f3e req-26dbf3fe-50d0-457f-b6fd-89af40e31436 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215210 Dec 03 03:35:46.390139 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 97/205] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:46 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:46.409434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:46.410807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:46.426552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:46.430944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.432061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:46.432711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:46.933432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.947424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.949876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.960635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:46.966982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-16ad71eb-bddb-4837-91f6-21d19f1233a8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.575324 Dec 03 03:35:46.967932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 98/206] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:46 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:46.969045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a227ddc1-ff6c-4e5a-8e01-106733c42fdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.798252 Dec 03 03:35:46.969856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 109/207] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:46 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:47.182347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:47.183059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:47.204101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:47.204591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:47.205724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:47.205913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:47.206702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:47.207350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:47.226953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:47.227501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:47.229221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:47.229717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:47.395307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:47.396028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:47.396590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lazy-loading 'fault' on Instance uuid 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:35:47.547174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:47.566740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4d14b245-a6d1-4b4e-8a70-ee60cecfe783 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 200 len: 1303 microversion: 2.1 time: 0.375327 Dec 03 03:35:47.570784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 110/208] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:47 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 1303 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:47.747574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:47.778121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e4e8420d-9ec7-487c-9abe-1cd40e1c3e45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1322 microversion: 2.1 time: 0.605911 Dec 03 03:35:47.790472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 99/209] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:47 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:47.997652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:48.003281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:48.003936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:48.004254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:48.020404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.021696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.022706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.023225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.023347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.024067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.024561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.024996 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.432049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:48.435249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:48.445439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c617348d-b3b6-4a6c-8a0d-e7082e77c9f6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.460923 Dec 03 03:35:48.446267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 111/210] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:47 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:48.448140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:48.456343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:48.457714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-af0aba5c-6902-4eaa-b5aa-62cbe0587487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.464611 Dec 03 03:35:48.458343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 100/211] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:47 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:48.591431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:48.592289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:48.601167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.601792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.602691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.603190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.663511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] HTTP exception thrown: Instance 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 could not be found. Dec 03 03:35:48.664194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Returning 404 to user: Instance 2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:35:48.665119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7215eeac-faad-43c5-bd1d-b36cff5bac09 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8" status: 404 len: 111 microversion: 2.1 time: 0.084527 Dec 03 03:35:48.666350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 112/212] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:48 2020] GET /compute/v2.1/servers/2c5a9bcc-4417-4079-8a92-1b9aa8f531e8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:35:48.829659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:48.849778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:48.882102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.882974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.884002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:48.884648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:48.890980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-607942201", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "160bc4c0-2e8b-4454-bcf7-456486062213"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:49.112726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] validate_networks() for [('160bc4c0-2e8b-4454-bcf7-456486062213', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:35:49.481494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:49.494062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-18fda058-fdbe-48e7-b04e-6ceb586e9af9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1516 microversion: 2.1 time: 0.687927 Dec 03 03:35:49.494936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 101/213] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:48 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1516 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:49.525595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:49.526668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:49.536778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:49.537512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:49.538751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:49.539313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.187903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:35:50.188375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:35:50.188915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:35:50.189408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:35:50.190951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:35:50.218004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:50.232156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.232880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.233613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.234546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.264449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d66cd088-008c-4b86-82c5-c0d93d683024 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.756076 Dec 03 03:35:50.265258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 102/214] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:49 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:50.282843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Getting quotas for project 7762d1a9afb04c66b6ced204aeaffe45. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:35:50.288332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Getting quotas for user 90d1d1034ade43fbabdbc00bed671409 and project 7762d1a9afb04c66b6ced204aeaffe45. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:35:50.292219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:50.294535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:50.301603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:35:50.304246 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:35:50.310629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.316142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.317365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.318199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.399667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ed962a6d-6cea-425a-b55c-e95f7692874c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522421 Dec 03 03:35:50.400377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 113/215] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:35:48 2020] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:35:50.427218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:50.428623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:50.454604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.455153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.456001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.456487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.540128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lazy-loading 'flavor' on Instance uuid 9955eb83-6d7f-4770-a851-4c648eda7deb {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:35:50.841269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-80471c59-27b6-463d-bcf8-12f03488ab7d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb/action" status: 200 len: 32 microversion: 2.1 time: 0.439686 Dec 03 03:35:50.842210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 114/216] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:35:50 2020] POST /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:35:50.889168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:50.893940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f71dfc4-ceb7-478e-9ea7-681059fd5fe8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:50.894751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6f71dfc4-ceb7-478e-9ea7-681059fd5fe8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:50.934075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:50.943466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:50.945005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ff212324-d1e1-4b1a-a59f-e4012010d646 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.677884 Dec 03 03:35:50.946450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 103/217] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:50 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:50.957576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:50.958549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:50.968071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.968892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:50.969972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:50.971125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:51.792362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6f71dfc4-ceb7-478e-9ea7-681059fd5fe8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:51.829516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f71dfc4-ceb7-478e-9ea7-681059fd5fe8 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1213 microversion: 2.1 time: 0.985770 Dec 03 03:35:51.839900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 115/218] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:50 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1213 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:51.858358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:51.862895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:51.888902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:51.889790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:51.890906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:51.891605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:52.138149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:52.165817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-abd24e11-8460-4da8-be38-660292df8b9c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 1.217986 Dec 03 03:35:52.166820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 104/219] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:50 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:52.188488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:52.189984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:52.210026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:52.214143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:52.215461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:52.217825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:53.064889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:53.088962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b99a7482-3a3f-44cd-bd42-0957d4222950 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 1.247506 Dec 03 03:35:53.089762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 116/220] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:51 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:53.107283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:53.108233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:53.117272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:53.118020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:53.119087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:53.119753 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:53.290703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:53.312127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-90ff6283-c4df-44f9-b8a2-6f261bf01579 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1271 microversion: 2.1 time: 0.220953 Dec 03 03:35:53.318848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 117/221] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:53 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:53.340006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:53.340812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:53.352971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:53.353487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:53.354375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:53.354872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:53.468074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:53.499847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:53.513347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:53.515038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b5af27e8-a214-4af0-9e3c-14a467bfafdc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 1.346989 Dec 03 03:35:53.516197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 105/222] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:52 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:54.093957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:54.113450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-76521ba2-21d6-4da2-a574-31550bd537ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.793355 Dec 03 03:35:54.114058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 118/223] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:53 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:54.117323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:54.126337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:54.142272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.144353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.145408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.146059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.344742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:54.346273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:54.363233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.364763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.365629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.366156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.608998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:54.631252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7945b7b1-1967-4d12-9af8-46970fdb8087 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1271 microversion: 2.1 time: 0.303910 Dec 03 03:35:54.641395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 119/224] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:54 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:54.642203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:54.643495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:54.651498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.652006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.652850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:54.653364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:54.712350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:54.723277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-757adfb0-c8ff-4072-9ab5-88b49bed4826 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.618073 Dec 03 03:35:54.723879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 106/225] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:54 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:55.140808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:55.140808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:55.155288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:55.155288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:55.155288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:55.155288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:55.157212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:55.176112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:55.207850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:55.209258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b9d4183d-83d5-47d4-877a-004e0d66bf93 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1741 microversion: 2.20 time: 0.576087 Dec 03 03:35:55.209981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 120/226] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:54 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1741 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:55.666905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:55.671217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:55.681528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:55.682317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:55.683677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:55.684176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:56.051312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:56.073897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-29167138-b018-48ef-9265-1c03c4eef7b0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.945500 Dec 03 03:35:56.079021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 107/227] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:55 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:56.104010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:56.104917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:56.114128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:56.114972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:56.116023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:56.116709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:56.577525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:56.595166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f95987fa-3e64-473d-80eb-31f2e5f8d9df tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.945487 Dec 03 03:35:56.596999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 121/228] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:55 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:56.616162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:56.618942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:56.636019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:56.637013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:56.638588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:56.640856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:56.789392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:56.800460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-648be57f-1e74-493b-a06a-f63f1c236b75 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.717820 Dec 03 03:35:56.800977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 108/229] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:56 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:57.109400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:57.110082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:57.121141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.121583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:57.122645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.123153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:57.174052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:57.240692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:57.274679 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:57.275940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5e6a5a28-b599-41d3-b03f-cc4c1608e98f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1741 microversion: 2.20 time: 0.677464 Dec 03 03:35:57.278967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 122/230] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:56 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1741 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:57.629247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:57.630775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:57.642195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.643654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:57.645222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.645862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:57.753406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:57.776584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c8e6d7d3-6871-4887-bbf5-806ad72cc315 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.683315 Dec 03 03:35:57.777445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 109/231] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:57 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:57.828746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:57.832929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:57.880376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.881269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:57.882327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:57.883131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:58.291034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:58.325577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bb0d8947-e3d0-4eb5-a523-de9fc2a35eac tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.714403 Dec 03 03:35:58.332294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 123/232] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:57 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:35:58.363797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:58.364885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:58.385651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:58.386583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:58.390287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:58.391220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:58.411008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:58.421221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b23d4066-81fd-4369-b95d-6f30b78a29a9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.602001 Dec 03 03:35:58.432268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 110/233] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:57 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:58.433760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-51fec7e3-6838-4ca7-8237-eaa5d5d30dfa req-842fe389-f048-4c6b-98d4-ee4e743e4ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e010b129-860c-4fa5-ba51-a2801a38faa3", "tag": "dd1403b1-9a76-4ae8-83f8-7f3696c7f716"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:35:58.441278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:35:58.441278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:35:58.466082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-51fec7e3-6838-4ca7-8237-eaa5d5d30dfa req-842fe389-f048-4c6b-98d4-ee4e743e4ca1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:58.474772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-51fec7e3-6838-4ca7-8237-eaa5d5d30dfa req-842fe389-f048-4c6b-98d4-ee4e743e4ca1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:58.519575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-51fec7e3-6838-4ca7-8237-eaa5d5d30dfa req-842fe389-f048-4c6b-98d4-ee4e743e4ca1 service nova] Creating event network-changed:dd1403b1-9a76-4ae8-83f8-7f3696c7f716 for instance e010b129-860c-4fa5-ba51-a2801a38faa3 on hv-cinder-74915 Dec 03 03:35:58.535858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-51fec7e3-6838-4ca7-8237-eaa5d5d30dfa req-842fe389-f048-4c6b-98d4-ee4e743e4ca1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111784 Dec 03 03:35:58.536531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 111/234] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:35:58 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:35:58.807466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:58.808479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:58.820276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:58.821809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:58.822541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:58.823470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:59.895188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:59.922552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:59.941923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-859bf73d-2563-4964-9aff-12239ecf1567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 1.149857 Dec 03 03:35:59.942780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 112/235] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:58 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:35:59.951461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:59.964788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:35:59.965653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:35:59.971002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:35:59.972344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-79711bd0-fe8a-4b8c-91eb-61f787f2b3ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 1.638694 Dec 03 03:35:59.972944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 124/236] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:35:58 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:35:59.974880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:59.975529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:59.976502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:35:59.977268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:35:59.996718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:00.008597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:00.047972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:00.050562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:00.052196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:00.053345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:00.579124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:00.590973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-676b6da3-531f-406c-9770-fa7527f2e2f6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.636399 Dec 03 03:36:00.591857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 113/237] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:59 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:00.604686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1858663444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1839724600", "security_groups": [{"name": "tempest-TestShelveInstance-1140165042"}], "networks": [{"uuid": "f60403ca-ab4d-44ff-a662-f33a863f9753"}], "block_device_mapping_v2": [{"uuid": "2ba4a4b3-be89-4653-ba39-42b103d0b2bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:00.658695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:00.678392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5b16d92e-556c-44ae-a3f8-9cbc27dc6b9f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.704179 Dec 03 03:36:00.701266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 125/238] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:35:59 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:00.976621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:00.981376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:00.994892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:00.995613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:00.996939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:00.997602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:01.027069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] validate_networks() for [('f60403ca-ab4d-44ff-a662-f33a863f9753', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:36:01.752853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:01.786112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5dedde69-2381-4742-8ae2-ee6f45c2a548 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.817058 Dec 03 03:36:01.786112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 126/239] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:00 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:01.795283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:01.795955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:01.808044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:01.808554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:01.809619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:01.813505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.343625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:02.360291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:02.368612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:02.371202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-765501ce-5179-4c9e-ba35-0ebcf9f220ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.595528 Dec 03 03:36:02.371416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 127/240] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:01 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:02.396047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:02.397059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:02.414812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.415634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.416710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.417398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.614780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:36:02.615890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:36:02.616641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:36:02.617306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:36:02.618415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:36:02.634572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.638728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.639805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.640307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.675306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:36:02.677738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Getting quotas for user 408d9f0256a6410bb861e24242e13f24 and project 1f4fcf788cc14d2eb287d7397fb1be0b. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:36:02.725521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:02.740489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ed5ad1ea-07bb-4726-9a44-3e917a4d7665 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.367869 Dec 03 03:36:02.741095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 128/241] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:02 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:02.754152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:02.755809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:02.775005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.775801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.776663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:02.777162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:02.833487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:36:02.835962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ba4a4b3-be89-4653-ba39-42b103d0b2bc',volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:36:03.056781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.072598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2eee76bc-1167-4ff7-9f0f-a87737e81f18 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.329356 Dec 03 03:36:03.073483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 129/242] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:02 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:03.084733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:03.085671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:03.086064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-50dab06d-465b-4ec4-ace4-3f3805a9aaff tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 2.492672 Dec 03 03:36:03.092708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 114/243] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:36:00 2020] POST /compute/v2.1/servers => generated 410 bytes in 2500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:36:03.096039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.097233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:03.100463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.102297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:03.104967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64641e93-9bb3-471d-85db-c11ebda1fc56 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:03.106646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64641e93-9bb3-471d-85db-c11ebda1fc56 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:03.324301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64641e93-9bb3-471d-85db-c11ebda1fc56 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.344522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64641e93-9bb3-471d-85db-c11ebda1fc56 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1089 microversion: 2.1 time: 0.247748 Dec 03 03:36:03.344522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 115/244] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:03 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1089 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:03.399479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:03.402612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:03.414323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.414957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:03.415883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.416439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:03.464331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.474601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-db23f737-06e6-4c3f-af7f-a237f930f1c1 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.399739 Dec 03 03:36:03.475360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 130/245] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:03 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:03.695267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.711019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.718056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:03.719289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b1b30a26-5b85-4221-92dc-3a4cb5dec1d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.331745 Dec 03 03:36:03.735143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 116/246] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:03 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:03.766080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:03.770999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:03.783857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.784609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:03.785612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:03.786588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.102581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:04.108886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:04.132375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.132880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.133725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.134212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.140087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:04.152132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-91a17580-5b4a-4041-975b-421c92a888c5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.396837 Dec 03 03:36:04.163778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 131/247] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:03 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:04.370985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:04.371801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:04.388465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.388975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.389833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.390381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.484447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:04.512133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7246c401-0186-4497-a303-c3c291d2b038 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.424454 Dec 03 03:36:04.512970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 117/248] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:04 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:04.534537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:04.535388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:04.548192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.554280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.554280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.554987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.662681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:04.687903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c6251d79-6a4b-4bdf-883b-f770fda32297 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1187 microversion: 2.1 time: 0.327903 Dec 03 03:36:04.702681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 132/249] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:04 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1187 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:04.714454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d13ef0f8-6a8f-428c-b5a3-e9bb9f4e90ce req-9d58ba37-da1c-4894-91fb-a36fa28d6d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b129-860c-4fa5-ba51-a2801a38faa3", "name": "network-vif-plugged", "status": "completed", "tag": "dd1403b1-9a76-4ae8-83f8-7f3696c7f716"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:04.722725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:04.722725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:04.733402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d13ef0f8-6a8f-428c-b5a3-e9bb9f4e90ce req-9d58ba37-da1c-4894-91fb-a36fa28d6d27 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.733904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d13ef0f8-6a8f-428c-b5a3-e9bb9f4e90ce req-9d58ba37-da1c-4894-91fb-a36fa28d6d27 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.756804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d13ef0f8-6a8f-428c-b5a3-e9bb9f4e90ce req-9d58ba37-da1c-4894-91fb-a36fa28d6d27 service nova] Creating event network-vif-plugged:dd1403b1-9a76-4ae8-83f8-7f3696c7f716 for instance e010b129-860c-4fa5-ba51-a2801a38faa3 on hv-cinder-74915 Dec 03 03:36:04.763163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d13ef0f8-6a8f-428c-b5a3-e9bb9f4e90ce req-9d58ba37-da1c-4894-91fb-a36fa28d6d27 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058919 Dec 03 03:36:04.763992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 133/250] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:04.776195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:04.777139 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:04.788539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.789056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:04.790134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:04.790823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:05.530928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:05.563282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:05.583954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:05.585192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0eeb1313-fddb-4d18-b98f-c5a94e880696 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.820154 Dec 03 03:36:05.596593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 134/251] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:04 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:05.605416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:05.606092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:05.633874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:05.642917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:05.645994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:05.649810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:05.650658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:05.651993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c65e0177-109a-42d0-8a25-72a101dfcf11 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 1.138067 Dec 03 03:36:05.662494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 118/252] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:04 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:05.664143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:05.664824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:05.672879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:05.674068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:05.675511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:05.676015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.074579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:06.086896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-871886ef-19ba-4499-b87b-bfd2116e08ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1313 microversion: 2.1 time: 0.499682 Dec 03 03:36:06.088263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 135/253] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:05 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:06.100538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:06.101613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:06.116328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.116838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.117689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.118513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.144845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:06.155586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-666126f4-b78e-481f-aeea-59e4d8f8aa3f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.501665 Dec 03 03:36:06.156213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 119/254] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:05 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:06.336722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:06.354792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-05383172-7ed4-4997-bf34-dcdd5668a869 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1205 microversion: 2.1 time: 0.264910 Dec 03 03:36:06.355723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 136/255] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:06 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1205 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:06.610562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:06.613458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:06.624646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.625167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.626039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.626671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.695322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:06.696001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:06.738021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.739015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:06.740441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:06.741305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.192914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:07.233199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:07.248362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:07.249632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-51316dc2-522e-47a1-96fa-1c1ba4cb175c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.649012 Dec 03 03:36:07.254533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 120/256] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:06 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:36:07.265367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:07.275590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:07.300981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.301849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.309460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.310097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.373740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:07.390307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-766ce9bd-6fbe-40e5-9ae6-4919b3421634 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.723009 Dec 03 03:36:07.394816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 137/257] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:06 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:07.404705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:07.405365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:07.432861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.433655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.434673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.435287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.769918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:07.788817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4e0160fa-565d-4f39-a2e4-fe00691da320 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1497 microversion: 2.1 time: 0.532683 Dec 03 03:36:07.789377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 121/258] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:07 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1497 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:07.799864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:07.800749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:07.813062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.813837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:07.815525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:07.816174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:08.348043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:08.368969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-093e03c5-7633-4328-b2e0-18e14a9b6113 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.973278 Dec 03 03:36:08.373482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 138/259] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:07 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:08.428183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:08.428864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:08.469624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:08.471573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:08.471573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:08.477556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:08.925795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:08.948883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1d9f588f-b54c-4c06-84d2-197d5437a72c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 1.158102 Dec 03 03:36:08.949836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 122/260] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:07 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:08.976585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:08.994117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:09.025792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:09.030379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:09.031448 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:09.032050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:09.155619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:09.208090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:09.227614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:09.236774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c47f68c9-5196-44b1-af42-820e8fddfbbc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.859088 Dec 03 03:36:09.238516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 139/261] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:08 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:09.409616 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:09.412282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:09.432998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:09.433353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:09.434219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:09.434735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.590732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:10.611477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8c4e7644-24a2-4990-92cb-dd673c58411e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 1.658253 Dec 03 03:36:10.612993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 123/262] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:08 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:10.628385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:10.629582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:10.643910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.644681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.645995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.646780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.707559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:10.723011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8b86c5a4-1296-428b-89e7-9317ae15bcf2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 1.334564 Dec 03 03:36:10.733640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 140/263] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:09 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:10.749802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:36:10.755684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:10.756459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:10.769783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.770318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.771179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.771702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.914522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-68f0b150-b30d-401c-aa35-8bf82f4c793e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "DELETE /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 204 len: 0 microversion: 2.1 time: 0.294645 Dec 03 03:36:10.916684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 124/264] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:36:10 2020] DELETE /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:36:10.933619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:10.934792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:10.945514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.946160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:10.947144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:10.947717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:11.556544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:11.574214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-227026f9-50a2-44e1-b1b2-81b37b1c5058 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.839096 Dec 03 03:36:11.585971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 141/265] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:10 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:11.601432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: .version_select at 0x7fe9157be268>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1903056999"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:11.610067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:11.640325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:11.641720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for project 0840879b0906445784a83ceb05926684. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:36:11.651977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:11.654073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f54f5a8-055c-4dc0-bdf9-1a9130e49263 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.732125 Dec 03 03:36:11.655762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 125/266] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:10 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:11.663180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for user 8522363549604fe1b2be8b5ac5a0c002 and project 0840879b0906445784a83ceb05926684. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:36:11.669501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:11.670917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:11.683479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:11.684834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:11.686646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:11.687293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.058492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for project 0840879b0906445784a83ceb05926684. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:36:12.063087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for user 8522363549604fe1b2be8b5ac5a0c002 and project 0840879b0906445784a83ceb05926684. Resources: {'key_pairs'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:36:12.078596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4ff79398-2e48-4883-bd21-6a41609644d0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.491066 Dec 03 03:36:12.079257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 142/267] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Dec 3 03:36:11 2020] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:12.090743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-253d411c-40e7-42cf-903b-424d35a493fa req-d9eda624-d45d-4a2e-8cb1-b3ee724b7ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:12.098275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:12.098275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:12.116076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-253d411c-40e7-42cf-903b-424d35a493fa req-d9eda624-d45d-4a2e-8cb1-b3ee724b7ebd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.116577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-253d411c-40e7-42cf-903b-424d35a493fa req-d9eda624-d45d-4a2e-8cb1-b3ee724b7ebd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.137527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-253d411c-40e7-42cf-903b-424d35a493fa req-d9eda624-d45d-4a2e-8cb1-b3ee724b7ebd service nova] Creating event network-changed:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:36:12.144729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-253d411c-40e7-42cf-903b-424d35a493fa req-d9eda624-d45d-4a2e-8cb1-b3ee724b7ebd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062877 Dec 03 03:36:12.145930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 143/268] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:12 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:12.157308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:12.158138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:12.159517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:12.169269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.169806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.170758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.171260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.203597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e4898541-e055-4c26-adb0-c523292db5a5 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1503 microversion: 2.1 time: 0.546057 Dec 03 03:36:12.221291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 126/269] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:11 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1503 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:12.239675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:12.240577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:12.249511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.250046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.251360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.251985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.719420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:12.736194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1d7a6a2a-f481-40b6-b4f1-dca969b016ea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1725 microversion: 2.1 time: 0.508290 Dec 03 03:36:12.737171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 127/270] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:12 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1725 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:12.747556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-13799595", "imageRef": "105bf4fb-33d7-4790-b3a0-7e629d0f0275", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1903056999", "networks": [{"uuid": "330d9e4d-fc33-4815-90f4-d12bca58f5a8"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:12.757941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:12.788534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-253ce720-9d6a-4827-8586-31364055c0ed tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.640802 Dec 03 03:36:12.789154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 144/271] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:12 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:12.809198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:12.810468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:12.819610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.820448 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.821840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:12.822607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:12.874565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] validate_networks() for [('330d9e4d-fc33-4815-90f4-d12bca58f5a8', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:36:13.763317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:13.781400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d7faf56b-5927-4ce6-8d03-5109e65b8688 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.990785 Dec 03 03:36:13.785212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 145/272] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:12 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:13.807498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:13.809815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:13.823413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:13.824840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:13.825816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:13.826462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:14.741921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:14.756793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:14.764165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:14.765455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b5f70660-2dfd-44ed-980e-4e179fbf2fc1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.977634 Dec 03 03:36:14.766059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 146/273] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:13 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:14.776358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:14.777024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:14.786639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:14.787592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:14.787984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:14.788476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.037312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:36:15.039084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:36:15.039887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:36:15.041268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:36:15.041945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:36:15.060567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.063485 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.067338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.070330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.105234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for project 0840879b0906445784a83ceb05926684. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:36:15.112630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Getting quotas for user 8522363549604fe1b2be8b5ac5a0c002 and project 0840879b0906445784a83ceb05926684. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:36:15.125664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:36:15.129652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='105bf4fb-33d7-4790-b3a0-7e629d0f0275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:36:15.218206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5360cbac-e270-4f86-87e8-a5aba8b95b74 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.479410 Dec 03 03:36:15.219521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 128/274] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:36:12 2020] POST /compute/v2.1/servers => generated 380 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:36:15.237760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:15.238812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:15.247948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.248778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.249857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.264975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.416077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:15.428296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1eb437ca-e92e-4a3b-b61a-b1d5e26cf2a6 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1503 microversion: 2.1 time: 0.660789 Dec 03 03:36:15.428626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 147/275] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:14 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1503 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:15.443317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:15.444020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:15.454832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.455338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:15.456194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:15.457248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.392847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:16.403566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-97cba6b0-1edc-47ee-8091-b4bb6a103026 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.973833 Dec 03 03:36:16.404524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 148/276] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:15 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:16.419312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:16.420364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:16.429490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:16.430402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.431466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:16.432799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.715601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:16.729907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-815abb4b-fa09-45df-a106-0eece7ac1bdf tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1702 microversion: 2.1 time: 1.507967 Dec 03 03:36:16.743026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 129/277] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:15 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1702 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:16.754505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-0af51170-1b03-4d6a-978a-a91e4f7a6204 req-bce55b5b-6cbd-4204-b9b9-64d0c687d254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b129-860c-4fa5-ba51-a2801a38faa3", "name": "network-vif-unplugged", "status": "completed", "tag": "dd1403b1-9a76-4ae8-83f8-7f3696c7f716"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:16.761921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:16.761921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:16.772184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-0af51170-1b03-4d6a-978a-a91e4f7a6204 req-bce55b5b-6cbd-4204-b9b9-64d0c687d254 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:16.772942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-0af51170-1b03-4d6a-978a-a91e4f7a6204 req-bce55b5b-6cbd-4204-b9b9-64d0c687d254 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.794524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-0af51170-1b03-4d6a-978a-a91e4f7a6204 req-bce55b5b-6cbd-4204-b9b9-64d0c687d254 service nova] Creating event network-vif-unplugged:dd1403b1-9a76-4ae8-83f8-7f3696c7f716 for instance e010b129-860c-4fa5-ba51-a2801a38faa3 on hv-cinder-74915 Dec 03 03:36:16.800704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-0af51170-1b03-4d6a-978a-a91e4f7a6204 req-bce55b5b-6cbd-4204-b9b9-64d0c687d254 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056113 Dec 03 03:36:16.801562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 130/278] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:16 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:16.815385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:16.816379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:16.825167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:16.825840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.827044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:16.827044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:16.949807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:16.974521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64f54a69-7f03-49bc-8f4e-338e4e4ab081 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.568470 Dec 03 03:36:16.985580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 149/279] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:16 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:17.010388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:17.011063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:17.036807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.037344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.042442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.043269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.370863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:17.382218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f9774231-02ef-49fd-9465-4416f4dbf2b8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1309 microversion: 2.1 time: 0.576816 Dec 03 03:36:17.383241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 131/280] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:16 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:17.394730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:17.396061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:17.404282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.405077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.406136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.406857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.605330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:17.615395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7b476a57-dcb9-4d26-ab8f-f7976136707e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.230719 Dec 03 03:36:17.616469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 132/281] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:17 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:17.627200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9a56a044-cd05-4947-95d0-32758adf56bd tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:17.636147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a56a044-cd05-4947-95d0-32758adf56bd tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.637050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a56a044-cd05-4947-95d0-32758adf56bd tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.715570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9a56a044-cd05-4947-95d0-32758adf56bd tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Going to try to start instance {{(pid=94249) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 03 03:36:17.810685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9a56a044-cd05-4947-95d0-32758adf56bd tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 202 len: 0 microversion: 2.1 time: 0.192459 Dec 03 03:36:17.811540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 133/282] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:36:17 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:36:17.826282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:17.827297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:17.836223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.836943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:17.837911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:17.838558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.028533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:18.047905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:18.058831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:18.060281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-08d5c7ca-e5a1-49bb-9656-954fb1e7d717 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 1.072270 Dec 03 03:36:18.060891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 150/283] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:16 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:18.072805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:18.073588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:18.085927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.086741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.089580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.089580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.464830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:18.478697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f6381e54-8b08-44cc-bfdf-4c92d476503e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.661965 Dec 03 03:36:18.479572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 134/284] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:17 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:18.502047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-5828352f-950e-4476-8c6e-98365fc59b22 req-6eb5d4e4-28cd-4937-a178-e0c705b90b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b129-860c-4fa5-ba51-a2801a38faa3", "name": "network-vif-deleted", "tag": "dd1403b1-9a76-4ae8-83f8-7f3696c7f716"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:18.509391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:18.509391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:18.525162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5828352f-950e-4476-8c6e-98365fc59b22 req-6eb5d4e4-28cd-4937-a178-e0c705b90b40 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.526026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5828352f-950e-4476-8c6e-98365fc59b22 req-6eb5d4e4-28cd-4937-a178-e0c705b90b40 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.551518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-5828352f-950e-4476-8c6e-98365fc59b22 req-6eb5d4e4-28cd-4937-a178-e0c705b90b40 service nova] Creating event network-vif-deleted:dd1403b1-9a76-4ae8-83f8-7f3696c7f716 for instance e010b129-860c-4fa5-ba51-a2801a38faa3 on hv-cinder-74915 Dec 03 03:36:18.557111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-5828352f-950e-4476-8c6e-98365fc59b22 req-6eb5d4e4-28cd-4937-a178-e0c705b90b40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070981 Dec 03 03:36:18.558011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 135/285] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:18 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:18.572747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:18.576022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:18.587413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.587934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.588802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.589300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.665121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:18.675910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c9d785da-a2f1-4680-8aa4-871b10ea55b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.613754 Dec 03 03:36:18.676731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 151/286] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:18 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:18.687247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:18.687917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:18.697525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.698062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:18.698945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:18.701543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.093059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.105374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-44e00d83-6793-4d4c-a3ac-50c98961b01e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1315 microversion: 2.1 time: 0.427371 Dec 03 03:36:19.106158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 152/287] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:18 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:19.125709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:19.125709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:19.132945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.133454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.134329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.134824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.213196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.238367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fe785c8b-412e-4881-a781-96108331db9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.676614 Dec 03 03:36:19.248272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 136/288] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:18 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:19.248832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:19.249466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:19.263991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.265105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.266167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.267016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.576601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.599215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ce3a0985-29a9-437b-b506-93e86f88b246 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.491369 Dec 03 03:36:19.604126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 153/289] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:19 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:19.625988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:19.626878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:19.636187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.636845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.637702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.638192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.693305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.708900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.716186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:19.717723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8602ad4f-4da2-40b9-b4f1-78431142d270 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.477757 Dec 03 03:36:19.718486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 137/290] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:19 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:19.729151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:19.730036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:19.743968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.744473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:19.745317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:19.745807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.252774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:20.255148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:20.264173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-55e10a7e-cdfe-4eb1-b947-1305a41f3313 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.658788 Dec 03 03:36:20.265624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 154/291] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:19 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:20.278812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:20.281352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:20.292780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1d3f5938-0bf4-446e-9db5-8c2543316053 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.572972 Dec 03 03:36:20.294194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.295258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.296068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 138/292] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:19 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:20.296357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.296995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.316751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:20.318183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:20.333327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.334295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.335365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.336006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.706807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:20.722664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6ce63a89-f76a-4048-854d-f25581e78a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.424153 Dec 03 03:36:20.723644 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 139/293] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:20 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:20.734281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:20.735273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:20.743923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.744703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.745901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.746617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.810798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:20.832185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-83a561f5-90cf-4153-9889-73d27037942d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.565084 Dec 03 03:36:20.832915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 155/294] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:20 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:20.857220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:20.857988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:20.866712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.867310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.868237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:20.868802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:20.901205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:20.918355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-890be982-39aa-48cf-8922-07eb2bf7c48c tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.193315 Dec 03 03:36:20.919503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 140/295] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:20 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:21.198683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:21.215937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:21.224395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:21.225668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-49691564-c68f-4a97-9fc4-5d73678f8e9e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.382046 Dec 03 03:36:21.226335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 156/296] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:20 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:21.289812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:21.290521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:21.300599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.301140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.302069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.302655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.320378 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:21.321424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:21.331036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.332088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.333857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.334594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.685628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:21.687556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:21.702165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fda87cdf-8a0b-4407-b885-6280351353eb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.421604 Dec 03 03:36:21.706411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 141/297] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:21 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:21.713441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-002f1e08-0e52-4d03-b35b-0b33ab15b67c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.399184 Dec 03 03:36:21.716425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 157/298] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:21 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:21.745876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:21.746608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:21.754738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.755241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.756085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.756570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.856772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:21.857445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:21.866427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.866944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:21.867798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:21.868291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.067335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.077006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d9f8d953-7406-4bbb-829a-38763b881925 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.340138 Dec 03 03:36:22.077611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 142/299] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:21 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:22.090701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:22.091376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:22.099857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.100500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.101352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.101968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.158906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.168383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ab2199b4-a8e4-4aa9-8c09-7b1047fb6b86 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.321423 Dec 03 03:36:22.168984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 158/300] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:21 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:22.251178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:22.251829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:22.258988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.260731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.261238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.262082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.262620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.273479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a6610023-7ae8-4d7a-aea3-356376a84c0e tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.194433 Dec 03 03:36:22.274086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 143/301] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:22 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:22.488681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.503627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.510431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:22.511634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b2c978b3-4b05-4944-bba0-54eeeaa0e54d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.270549 Dec 03 03:36:22.512221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 159/302] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:22 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:36:22.728550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:22.729135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:22.737166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.737671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.738174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:22.738534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.738873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:22.739030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.747185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.747737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:22.748571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:22.749062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.081797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.100946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-610131f9-f98c-4339-b757-85a6461c5d91 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.381470 Dec 03 03:36:23.112313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 144/303] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:22 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:23.112674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:23.113226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:23.121495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.121987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.122858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.123343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.186770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.235014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b41e7aa6-25a8-4f36-9aec-8cf3550c0343 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.495841 Dec 03 03:36:23.247913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 160/304] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:22 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:23.261684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:23.275202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:23.295611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.299026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.303199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.304117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.461297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.475939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-54c97ca6-4a64-4d66-9b6c-615801637feb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.372738 Dec 03 03:36:23.477012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 145/305] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:23 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:23.489940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:23.490757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:23.533065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.533596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.534500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.534999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.664390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.681345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-104a3277-4bd7-4eed-8b5b-221f1f63badb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.431872 Dec 03 03:36:23.682171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 161/306] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:23 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:23.692718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:23.693381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:23.702282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.702530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.708573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:23.708573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:23.721916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.731822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a977c015-a07a-4e48-bac6-079e21e87746 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.253327 Dec 03 03:36:23.734357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 146/307] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:23 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:23.966179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.980943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.988182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:23.989396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3c661d61-f0c4-4251-9c56-845259d8d5bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.306398 Dec 03 03:36:23.990190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 162/308] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:23 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:24.125885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:24.127342 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:24.134816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.135584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.136427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.136918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.272425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:24.273217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:24.281405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.282013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.283568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.284266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.406922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:24.416575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-48b46bba-e21e-405e-9d19-93a6a62aa38c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.299777 Dec 03 03:36:24.417157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 147/309] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:24 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:24.500628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:24.501821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:24.511243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.512106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.513161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.513855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.565578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:24.575094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1df919d4-c86b-4098-a25e-43ee29c2cda9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.312620 Dec 03 03:36:24.576081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 163/310] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:24 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:24.706377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:24.719249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:24.731965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.732481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.733436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.733910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.753177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:24.776700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6378ecb5-a92b-4c5e-90b2-d21b036c2f37 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.285584 Dec 03 03:36:24.777899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 148/311] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:24 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:24.789778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:24.790824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:24.800408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.801266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.802385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:24.803144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:24.999077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.021585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-14189867-42eb-48ad-968d-686012153e3b tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.242136 Dec 03 03:36:25.022400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 149/312] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:24 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:25.039052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:25.039884 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:25.051966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.055039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.056097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.058295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.071810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.082780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f8075e50-8129-428d-abf0-972aaadc7783 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.386702 Dec 03 03:36:25.099814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 164/313] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:24 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:25.349100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.365087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.372558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.373995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7052bf53-6853-4294-8654-52f88a09ad45 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.350299 Dec 03 03:36:25.374982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 150/314] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:25 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:25.444824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:25.445770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:25.454104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.455154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.455624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.456119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.599790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:25.600465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:25.608633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.609166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.610031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.610722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.704476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.722552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1b9955dc-1b6d-4c8e-bb16-6dbdbfd18be6 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.287795 Dec 03 03:36:25.733795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 165/315] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:25 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:25.815339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:25.816030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:25.824381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.824940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.825782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:25.826287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:25.855141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:25.880502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c48642c0-bea2-4817-9327-535dc6fdbb65 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.291107 Dec 03 03:36:25.891409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 151/316] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:25 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:26.047449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:26.048771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:26.056707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.057225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.058076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.058584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.065442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.075193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3cdc2c6-3e1f-4ce4-a12a-0fa17b34138d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.281705 Dec 03 03:36:26.075899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 166/317] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:25 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:26.107128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:26.107915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:26.116321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.116916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.117840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.118450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.271752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.289690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-95e4b6a7-43d7-4d15-9cae-f919c60f5f87 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.251079 Dec 03 03:36:26.289902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 152/318] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:26 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:26.372337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.382572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9e371d12-01bf-4dc7-9997-fbe15a8f4ce7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.284829 Dec 03 03:36:26.383529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 167/319] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:26 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:26.400429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:26.401204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:26.409611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.410123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.410998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.411495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.650276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.666434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.674315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:26.675517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8d766b1b-2a2b-43b7-9e9d-d3fdbcd09999 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.284582 Dec 03 03:36:26.676110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 153/320] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:26 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:26.758187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:26.758873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:26.767359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.767812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.768645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.769142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.903847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:26.904513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:26.913703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.914553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.915499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:26.916215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:26.997495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.007830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fa566074-ba46-4987-9439-ed669c4867dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.259409 Dec 03 03:36:27.008780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 168/321] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:26 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:27.100187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:27.100872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:27.120339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.120846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.121704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.122415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.157095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.167760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-78772202-728b-4bbf-8f92-3798276d5b6c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.272814 Dec 03 03:36:27.168411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 154/322] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:26 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:27.319613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:27.320469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:27.328927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.330761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.331693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.332197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.417020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.427687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-915dbb9e-726a-45cd-90ae-27240648b3b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.338380 Dec 03 03:36:27.428487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 169/323] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:27 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:27.438357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:27.439054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:27.447202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.447700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.448550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.449036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.492532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.502150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-83f2e920-f28d-4a33-877b-7a103e522140 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.193739 Dec 03 03:36:27.502802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 155/324] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:27 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:27.702048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:27.702714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:27.711014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.711241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.711520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.712367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:27.712852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:27.734847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d8cec7db-88b2-44f0-8e21-0ddff795bb37 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.304715 Dec 03 03:36:27.735226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 170/325] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:27 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:27.965761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.980796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.987947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:27.989127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2532608c-0ecd-43f8-86d0-0a9b69d86b4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.297322 Dec 03 03:36:27.989703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 156/326] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:27 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:36:28.043398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:28.044084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:28.055091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.055603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.056463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.056961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.193282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:28.194330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:28.203450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.203959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.206042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.206681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.591066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:28.600793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ffcedfdc-7781-4cb3-a1fa-53b945553724 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.577377 Dec 03 03:36:28.601405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 171/327] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:28 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:28.613723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:28.614748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:28.623548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.624063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.624634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:28.624920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.638080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6e2dc807-0d18-4c7c-b95c-207f538c8d4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.455427 Dec 03 03:36:28.639202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 157/328] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:28 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:28.642354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.652315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:28.653340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:28.663592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.664138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.664987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.665518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.840752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:28.855227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a5cf3cd9-af4a-4d9e-887b-3b5b1f95d787 tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.214513 Dec 03 03:36:28.862986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 158/329] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:28 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:28.866212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:28.866945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:28.875037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.875546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.876902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:28.877397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:28.956014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:28.964967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-26995a1f-2282-496e-af43-263c094f2382 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.362516 Dec 03 03:36:28.965788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 172/330] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:28 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:29.014086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:29.014786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:29.023169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.023683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:29.024535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.025034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:29.158925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:29.167864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4dfd99ce-2285-45bc-9c1c-30f755fb1dd7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.310678 Dec 03 03:36:29.170255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 159/331] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:28 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:29.277412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:29.291993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:29.299088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:29.300340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cdae3310-b9e5-4c81-822f-abcfc0201aa4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.295986 Dec 03 03:36:29.300874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 173/332] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:29 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:36:29.624889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:29.625551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:29.635750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.636410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:29.637255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.637741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:29.664691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:29.665472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:29.675456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.676163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:29.677096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:29.677671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.009732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.014520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.027966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-42cb9c09-dc1c-4b81-aad7-284d49567bcd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.412407 Dec 03 03:36:30.034028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 160/333] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:29 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:30.036427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6e22522b-03e4-40e9-ad61-fcee648dbdfe tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.379964 Dec 03 03:36:30.037168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 174/334] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:29 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:30.056652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:30.059151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:30.061891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:30.062830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:30.068369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.069012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.069947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.070534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.072929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.073845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.075477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.075999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.241476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.273501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0b0bd454-ba00-4b9e-b925-f1c57c93a3ee tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.238144 Dec 03 03:36:30.274312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 161/335] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:30 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:30.284765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:30.285560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:30.294044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.294723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.295699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.296303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.430927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.446285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9874cb40-e05b-4154-9eb2-4d32a4312ad1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.401927 Dec 03 03:36:30.447093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 175/336] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:30 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:30.459411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:30.460258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:30.471656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.475184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.476228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:30.476743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:30.712880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.723371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e91addde-d44a-4c6d-9949-ebe8e068c97a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.447940 Dec 03 03:36:30.723986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 162/337] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:30 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:30.798788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.813094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.824648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:30.826533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1dbe06ed-653c-4974-9e98-66594842094b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.377840 Dec 03 03:36:30.827204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 176/338] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:30 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:31.062432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.062432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.068484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.068832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.069159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.069471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.070462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.071038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.077633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.078146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.079044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.080445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.430518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:31.436773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:31.440601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b3e8e4fb-e8c7-4937-b7c8-c6ee53bcebe2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.382293 Dec 03 03:36:31.441198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 177/339] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:31.446496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-673965e6-4d1b-4f47-adec-b01763812775 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.398752 Dec 03 03:36:31.447249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 163/340] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:31.450840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.451495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.459358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.459850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.460687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.461172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.469415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.470376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.484952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.486027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.501013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.501813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.681135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:31.695699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e89c2585-0518-44f1-8284-0bd15388d64a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1461 microversion: 2.1 time: 0.253349 Dec 03 03:36:31.696498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 178/341] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1461 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:31.747134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.747818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.768025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.768612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.769465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.770759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.818014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:31.827655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-78a8438e-e3bb-41c9-8abe-eded43b9698b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.367127 Dec 03 03:36:31.828567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 164/342] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:31.854315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:31.855060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:31.864054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.864603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:31.865528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:31.865991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:32.089851 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:32.099506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2c42a63a-37c4-43a6-aa3e-8744c412471f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.362233 Dec 03 03:36:32.100123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 179/343] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:32.151459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:32.166808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:32.173925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:32.175155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d1d8b2a6-bbaa-4068-bcfc-74e003435d69 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1736 microversion: 2.20 time: 0.331208 Dec 03 03:36:32.175743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 165/344] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:31 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:36:32.464987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:32.465577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:32.469513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:32.470817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:32.475832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:32.476341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:32.477209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:32.477660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:32.479155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:32.479633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:32.480414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:32.481063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.085338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:33.094571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1a6f5f55-df44-4a89-909e-2bd1a7bd7a54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.634380 Dec 03 03:36:33.095941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 166/345] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:32 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:33.106497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:33.107382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:33.117952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.118515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.119391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.120050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.151105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:33.162649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-487cb1de-c6fb-4e69-9f99-4959ceb5bf70 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.706943 Dec 03 03:36:33.163398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 180/346] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:32 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:33.176089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:33.190781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:33.211055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.211952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.215346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.216117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.380812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.381331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.381862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lazy-loading 'fault' on Instance uuid e010b129-860c-4fa5-ba51-a2801a38faa3 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:36:33.501987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d1d1034ade43fbabdbc00bed671409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7762d1a9afb04c66b6ced204aeaffe45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:33.511361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-13718286-023e-4107-ad4b-1e86168f53fa tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 200 len: 1303 microversion: 2.1 time: 0.414220 Dec 03 03:36:33.522097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 167/347] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:33 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 1303 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:33.522281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:33.522843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:33.530869 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.532502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:33.532502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:33.533271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:34.432827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:34.448349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de443250-aa7a-4ee6-beb2-fb0d99d58a4f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 1.283124 Dec 03 03:36:34.449307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 181/348] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:33 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:34.469166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:34.470004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:34.478961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:34.479479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:34.480350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:34.480846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:34.678696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:34.688601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef5b23c2-ba7c-4a62-8bda-05c96bf7cc62 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 1.175516 Dec 03 03:36:34.690569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 168/349] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:33 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:34.710470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:34.711735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:34.722188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:34.723299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:34.724414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:34.725131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.142371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.156752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.163582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.164825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-abd79b7e-6030-4835-8b82-c4b81dd810a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1718 microversion: 2.20 time: 0.713660 Dec 03 03:36:35.165405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 182/350] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:34 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1718 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:35.175543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:35.176207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:35.201397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.201901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.202769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.203259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.373672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.382639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a29be72e-9d8a-4490-a23b-87b233086e54 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1522 microversion: 2.1 time: 0.691594 Dec 03 03:36:35.383178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 169/351] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:34 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:35.393643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:35.394320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] [instance: e010b129-860c-4fa5-ba51-a2801a38faa3] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:35.402082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.402626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.403569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.404053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.458214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] HTTP exception thrown: Instance e010b129-860c-4fa5-ba51-a2801a38faa3 could not be found. Dec 03 03:36:35.458933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] Returning 404 to user: Instance e010b129-860c-4fa5-ba51-a2801a38faa3 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:36:35.459794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8cad7102-767a-43b3-a138-7cc37d0e361a tempest-VolumesActionsTest-378150590 tempest-VolumesActionsTest-378150590] 10.222.0.66 "GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3" status: 404 len: 111 microversion: 2.1 time: 0.075638 Dec 03 03:36:35.463758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 170/352] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:35 2020] GET /compute/v2.1/servers/e010b129-860c-4fa5-ba51-a2801a38faa3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:36:35.476199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:35.476306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:35.484225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.484738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.486824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.486824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.758396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.772867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e12c29a1-0e35-4d42-84d3-b401055ec088 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1711 microversion: 2.1 time: 0.606323 Dec 03 03:36:35.781113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 183/353] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:35 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1711 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:35.804339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:35.806593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:35.817597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.818687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.819901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.820724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:35.897166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:35.927439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-339c0fbd-0e3c-46c1-a10e-9994021dc4a8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.462451 Dec 03 03:36:35.928365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 171/354] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:35 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:35.947747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-ac4f0be0-6b4e-49cc-aca7-97cbb04f0b02 req-64142eda-b958-4f8b-822d-0489cbc0aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:35.959878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:35.959878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:35.987165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ac4f0be0-6b4e-49cc-aca7-97cbb04f0b02 req-64142eda-b958-4f8b-822d-0489cbc0aad9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:35.987677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ac4f0be0-6b4e-49cc-aca7-97cbb04f0b02 req-64142eda-b958-4f8b-822d-0489cbc0aad9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.015569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-ac4f0be0-6b4e-49cc-aca7-97cbb04f0b02 req-64142eda-b958-4f8b-822d-0489cbc0aad9 service nova] Creating event network-changed:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:36:36.031875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-ac4f0be0-6b4e-49cc-aca7-97cbb04f0b02 req-64142eda-b958-4f8b-822d-0489cbc0aad9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101717 Dec 03 03:36:36.032429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 172/355] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:35 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:36.266828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:36.269996 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:36.278978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.279753 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.280744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.281236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.476420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:36.497319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-77ea3c56-66de-45e5-9a56-497400227ee2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.714795 Dec 03 03:36:36.498224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 184/356] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:35 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:36.529271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:36.533995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:36.554593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.560425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.561477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.562117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.670003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:36.697476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:36.704978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:36.706264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a870b117-77d6-4990-ba9b-f7a8cce6e9d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1718 microversion: 2.20 time: 0.520540 Dec 03 03:36:36.707255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 173/357] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:36 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1718 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:36.739295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-4ef26a87-03b0-417c-944e-de43ed539a8e req-bbd2c96e-c91a-4a30-95cf-d9c378c6289a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "name": "network-vif-plugged", "status": "completed", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:36.765765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:36.765765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:36.795889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-4ef26a87-03b0-417c-944e-de43ed539a8e req-bbd2c96e-c91a-4a30-95cf-d9c378c6289a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.796680 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-4ef26a87-03b0-417c-944e-de43ed539a8e req-bbd2c96e-c91a-4a30-95cf-d9c378c6289a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.832249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-4ef26a87-03b0-417c-944e-de43ed539a8e req-bbd2c96e-c91a-4a30-95cf-d9c378c6289a service nova] Creating event network-vif-plugged:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:36:36.838146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-4ef26a87-03b0-417c-944e-de43ed539a8e req-bbd2c96e-c91a-4a30-95cf-d9c378c6289a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129197 Dec 03 03:36:36.839374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 174/358] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:36 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:36.857251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:36.864238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:36.902194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.903678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:36.905817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:36.909724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:37.607802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:37.619001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:37.633178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a2cbb7d7-8691-4760-b0b6-fab683dbdf18 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1502 microversion: 2.1 time: 1.133540 Dec 03 03:36:37.633801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 185/359] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:36 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1502 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:37.635452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fc02fac6-0205-4b75-a3f2-90d1d7f30ceb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1715 microversion: 2.1 time: 0.793576 Dec 03 03:36:37.638190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 175/360] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:36 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1715 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:37.644860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:37.645887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:37.654474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:37.655273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:37.656773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:37.658075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:37.664419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:37.665035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:37.674322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:37.674871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:37.675729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:37.676225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.005831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.009840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.015221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5fac5a5e-f46d-4790-affa-9ae29b4f7086 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.380325 Dec 03 03:36:38.015804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 186/361] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:37 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:38.019204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6cd2b8d5-db98-4374-99df-81c19b4eedfc tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.378955 Dec 03 03:36:38.019778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 176/362] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:37 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:38.027798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:38.028738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:38.029878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:38.030566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:38.039196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.039701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.039986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.040541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.040639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.041025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.041560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.042127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.369569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.379696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.380342 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c5fd836d-34a4-489d-91a0-20d4f182ec71 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1516 microversion: 2.1 time: 0.362988 Dec 03 03:36:38.381093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 187/363] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:38 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:38.395437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.402229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:38.403484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2b549ecc-4570-49a2-a8f2-41458c437172 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1721 microversion: 2.20 time: 0.382722 Dec 03 03:36:38.404237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 177/364] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:38 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:38.429561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ae205c-5970-4ddb-b2ea-95c0add1e6d0"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:38.431705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:38.440296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.440809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:38.441845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:38.442369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.039581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:39.040225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:39.048501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.049003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.049838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.050351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.161915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e797e222-dc42-4522-a93d-d9302d4a0aaa tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.742966 Dec 03 03:36:39.162634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 188/365] 10.222.0.66 () {62 vars in 1354 bytes} [Thu Dec 3 03:36:38 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments => generated 188 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:36:39.172702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:39.173609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:39.198492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.200224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.200582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.201273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.293215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:39.302943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b0df8926-bf67-4bdc-a3b7-587058411d79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.273726 Dec 03 03:36:39.303553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 178/366] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:39 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:39.313686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:39.315361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:39.328201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.329147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.331317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.332256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.447472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:39.457073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-abd2b4f1-0548-4ace-be7e-bb7f77682942 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.293382 Dec 03 03:36:39.457666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 189/367] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:39 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:39.497645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d3b3f197-d42c-4271-b027-1ac6208a64e4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action" status: 202 len: 0 microversion: 2.20 time: 0.192955 Dec 03 03:36:39.498333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 179/368] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:36:39 2020] POST /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:36:39.513037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:39.513706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:39.522364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.522873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.523717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:39.524405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:39.755279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:39.770708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:39.777203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:39.778431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d25c56da-4bfd-42f8-891f-cb049da0280b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1807 microversion: 2.20 time: 0.274863 Dec 03 03:36:39.779014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 190/369] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:39 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:40.326014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:40.326703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:40.335150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.335654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:40.336476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.336963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:40.481589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:40.482401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:40.490947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.491457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:40.492310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.492803 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:40.560896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:40.570100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d464b0a0-4a4a-4769-bfdc-678f1fbbff84 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.253188 Dec 03 03:36:40.570916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 180/370] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:40 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:40.721493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:40.730575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4609ef06-7fa0-487f-89c7-35af20336b34 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.258556 Dec 03 03:36:40.731154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 191/371] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:40 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:40.802929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:40.803667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:40.811735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.812292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:40.813184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:40.814230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:41.195137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:41.214623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:41.221262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:41.222552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e19cc324-6c46-4f56-a0ff-4f2c2ef71b77 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1807 microversion: 2.20 time: 0.429306 Dec 03 03:36:41.223144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 181/372] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:40 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1807 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:41.264184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-2594e9ec-0a51-4f36-a8fd-d67e3d51c356 req-f830f67d-9801-433e-bdb3-4691c7834444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "name": "network-vif-unplugged", "status": "completed", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:41.271334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:41.271334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:41.280263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2594e9ec-0a51-4f36-a8fd-d67e3d51c356 req-f830f67d-9801-433e-bdb3-4691c7834444 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:41.280758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2594e9ec-0a51-4f36-a8fd-d67e3d51c356 req-f830f67d-9801-433e-bdb3-4691c7834444 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:41.299461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-2594e9ec-0a51-4f36-a8fd-d67e3d51c356 req-f830f67d-9801-433e-bdb3-4691c7834444 service nova] Creating event network-vif-unplugged:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:36:41.304795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-2594e9ec-0a51-4f36-a8fd-d67e3d51c356 req-f830f67d-9801-433e-bdb3-4691c7834444 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050389 Dec 03 03:36:41.305743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 192/373] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:41 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:41.594494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:41.596296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:41.604341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:41.604832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:41.605719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:41.606393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:41.756625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:41.757739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:41.766772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:41.767288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:41.768163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:41.768645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.216267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:42.232551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e9547aa7-e1a4-4db9-aaf9-bd18bcef2cc0 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1265 microversion: 2.1 time: 0.647481 Dec 03 03:36:42.244737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:42.250914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 182/374] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:41 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1265 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:42.268435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-57dd8c80-e5ab-4d67-b337-fe63ce400f6d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.522280 Dec 03 03:36:42.268844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 193/375] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:41 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:42.275914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:42.276557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:42.296509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.297019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.297866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.298455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.384366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:42.385733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:42.408925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.409430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.415781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.416367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.553845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lazy-loading 'flavor' on Instance uuid 2846e1b1-6107-4523-a287-f599394f984f {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:36:42.699516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:42.719007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:42.727910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:42.729419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d7b74d98-3b1a-4926-ad64-c3989bdee937 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1749 microversion: 2.20 time: 0.476186 Dec 03 03:36:42.730057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 183/376] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:42 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1749 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:42.747894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-70c777f0-b9eb-42e6-9324-9005c7bfcd4e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action" status: 200 len: 32 microversion: 2.1 time: 0.373120 Dec 03 03:36:42.748560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 194/377] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:36:42 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 03:36:42.764704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:42.765343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:42.774005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.774534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:42.775371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:42.775838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.167240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:43.179795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3f1f34ba-ab08-43de-8c36-45b7078fa884 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.424277 Dec 03 03:36:43.180223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 184/378] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:42 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:43.276170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:43.276937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:43.285354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.285863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.286770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.287254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.299219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:43.300195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:43.311454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.312866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.315315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.316420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.639695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:43.653617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dea0d960-ad3d-4e8c-a9c3-e00e0b69e84f tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1450 microversion: 2.1 time: 0.387628 Dec 03 03:36:43.667994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 195/379] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:43 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1450 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:43.680277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:43.728000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:43.728000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:43.752148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-afaae807-93a3-4fa3-a990-3bf1370f1a23 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.451771 Dec 03 03:36:43.755737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 185/380] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:43 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:36:43.763868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.764405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.765292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.770083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:43.771065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:43.774959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.780236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.780741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:43.781587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:43.782551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:44.152074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:44.155915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:44.167223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-868b6153-e40c-4f23-b53a-3122e5558d32 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1450 microversion: 2.1 time: 0.494493 Dec 03 03:36:44.168434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 196/381] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:43 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1450 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:44.178537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:44.181836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:44.182886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-587b4df8-0cc5-4753-8c92-4f3fb0591bef tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1749 microversion: 2.20 time: 0.425759 Dec 03 03:36:44.183629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 186/382] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:43 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1749 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:44.199604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-565c1db4-b363-4df6-8519-096ad47a3e9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'create', calling method: .version_select at 0x7fe9169ad620>, body: {"pool": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:44.204310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:44.205364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:44.213811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:44.214680 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:44.215745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:44.216446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:44.740224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:44.771608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8ac274e8-4c6e-4357-b024-1d1f73c1e181 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.576528 Dec 03 03:36:44.772906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 187/383] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:44 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:44.790162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:44.791529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:44.802841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:44.803356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:44.804204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:44.804696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:45.371416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:45.384510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-243a465f-a3cc-4389-8a96-292a608a00f1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.610181 Dec 03 03:36:45.385970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 188/384] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:44 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:45.422836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:45.425041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:45.434606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:45.435504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:45.437293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:45.438022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:45.763906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:45.780207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:45.787075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:45.788311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0beda2fb-f508-4c52-bd4b-51c55d5648ad tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1749 microversion: 2.20 time: 0.401341 Dec 03 03:36:45.789168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 189/385] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:45 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1749 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:45.799494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:45.800166 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:45.812285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:45.812806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:45.814630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:45.814858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:46.513738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:46.524732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3fde3322-ad6a-44e7-8879-01ac11e81b42 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.734365 Dec 03 03:36:46.535854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 190/386] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:45 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:46.546575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:46.547237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:46.561250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:46.561731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:46.562685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:46.563154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:47.188430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:47.212309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2abf2b6c-812e-4523-9fb5-4d5c4f7a1876 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.675173 Dec 03 03:36:47.212940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 191/387] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:46 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:47.228346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:47.229036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:47.246536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:47.247054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:47.247912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:47.248408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:47.930270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:47.960213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:47.968065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:47.970099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e2961829-9531-4a27-a0d0-b45bfffcd123 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1749 microversion: 2.20 time: 0.755941 Dec 03 03:36:47.971052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 192/388] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:47 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1749 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:47.998788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:47.999633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:48.009928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:48.010719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:48.011790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:48.012294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:48.980607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:48.994703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1ea41523-2c94-4069-bb63-d81c8cd19e2e tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 1.021825 Dec 03 03:36:48.995581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 193/389] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:47 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:49.008124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f36a7a2c-2d3e-44ac-9743-4e6d86d56d59 req-50afd974-2e9c-4577-93f4-755eb118c39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "name": "network-vif-plugged", "status": "completed", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:49.015957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:49.015957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:49.027977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f36a7a2c-2d3e-44ac-9743-4e6d86d56d59 req-50afd974-2e9c-4577-93f4-755eb118c39e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.028883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f36a7a2c-2d3e-44ac-9743-4e6d86d56d59 req-50afd974-2e9c-4577-93f4-755eb118c39e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.056564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-565c1db4-b363-4df6-8519-096ad47a3e9c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.873178 Dec 03 03:36:49.056844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f36a7a2c-2d3e-44ac-9743-4e6d86d56d59 req-50afd974-2e9c-4577-93f4-755eb118c39e service nova] Creating event network-vif-plugged:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:36:49.057192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 197/390] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Dec 3 03:36:44 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:49.061927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f36a7a2c-2d3e-44ac-9743-4e6d86d56d59 req-50afd974-2e9c-4577-93f4-755eb118c39e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065091 Dec 03 03:36:49.064502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 194/391] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:48 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:49.072332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:49.073269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:49.076056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:49.076939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:49.085035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.086156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.087265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.087963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.091304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.091816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.092744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.093241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.817215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:49.828765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:49.839307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7abc255f-93f7-4424-b12f-35046235f067 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 0.780385 Dec 03 03:36:49.840574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 198/392] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:49 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:49.846372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:49.851536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'action', calling method: .version_select at 0x7fe9178e7048>, body: {"addFloatingIp": {"address": "172.27.0.99"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:49.853236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:49.862228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:49.863618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6eaeda8d-2115-4bad-94c4-2a486273b7b7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1749 microversion: 2.20 time: 0.797808 Dec 03 03:36:49.864228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 195/393] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:49 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1749 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:49.864342 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.865050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.866007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:49.866660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:49.953945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Acquired lock "refresh_cache-7d1cee60-e1d6-4b2c-a218-27203e9065f6" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:36:50.035365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:50.045110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:50.058199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:50.061397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:50.067965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:50.068477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:51.053237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:51.084894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-897e2c09-b5c9-4c6a-8e83-a3b83c75dc4c tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 1.074883 Dec 03 03:36:51.096086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 196/394] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:50 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:51.107701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:51.108713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:51.122508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:51.124023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:51.124901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:51.125395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:52.125028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:52.143653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-31b41364-0497-4010-8ee7-3e3bbb0c6cb2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1357 microversion: 2.1 time: 1.045979 Dec 03 03:36:52.144469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 197/395] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:51 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1357 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:52.154503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:52.155409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:52.164569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:52.165275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:52.166327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:52.166971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:52.841475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:52.874333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:52.896131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:52.900557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f3579650-4897-4f59-b162-f8f2f052c05b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.754905 Dec 03 03:36:52.903358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 198/396] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:52 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:52.932524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:52.933689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:52.951630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:52.952421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:52.953127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:52.953690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:53.067183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Building network info cache for instance {{(pid=94250) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:36:53.647253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:53.665560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e07eecea-8249-407e-a145-ed4a3dd4dbe3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.759153 Dec 03 03:36:53.666201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 199/397] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:52 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:53.695865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-9e167167-395f-4591-97ba-492930e94871 req-4955509a-0156-433c-926e-24d30139a4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:53.707812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:53.707812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:53.731168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9e167167-395f-4591-97ba-492930e94871 req-4955509a-0156-433c-926e-24d30139a4f2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:53.731684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9e167167-395f-4591-97ba-492930e94871 req-4955509a-0156-433c-926e-24d30139a4f2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:53.760471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-9e167167-395f-4591-97ba-492930e94871 req-4955509a-0156-433c-926e-24d30139a4f2 service nova] Creating event network-changed:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:36:53.766026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-9e167167-395f-4591-97ba-492930e94871 req-4955509a-0156-433c-926e-24d30139a4f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093613 Dec 03 03:36:53.767582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 200/398] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:36:53 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:53.778838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:53.779916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:53.792062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:53.792865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:53.793896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:53.794595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:54.705924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:54.728579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e9c4f995-4fb0-49c4-8950-f7d91c8ca223 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1547 microversion: 2.1 time: 0.959399 Dec 03 03:36:54.732239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 201/399] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:53 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1547 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:54.771493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:54.772159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:54.795544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:54.795911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:54.796796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:54.797276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:55.707251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:55.748105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:55.756094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:55.757118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0a9d4d84-a895-4351-a35d-ee14b633b1a1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 1.009176 Dec 03 03:36:55.769704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 202/400] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:54 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:55.795065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:55.795829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:55.814714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:55.815216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:55.816162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:55.816726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:55.905576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Updating instance_info_cache with network_info: [{"id": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70", "address": "fa:16:3e:cb:96:14", "network": {"id": "f60403ca-ab4d-44ff-a662-f33a863f9753", "bridge": "br-int", "label": "tempest-TestShelveInstance-1145940515-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1f4fcf788cc14d2eb287d7397fb1be0b", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapec2a7db3-d8", "ovs_interfaceid": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94250) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:36:55.925185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Releasing lock "refresh_cache-7d1cee60-e1d6-4b2c-a218-27203e9065f6" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:36:55.926443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a88f3a15-4fb3-4548-8f0b-0d2c6e1eb6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action" status: 202 len: 0 microversion: 2.1 time: 6.084613 Dec 03 03:36:55.927367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 199/401] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:36:49 2020] POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action => generated 0 bytes in 6086 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 03:36:55.947987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:55.955581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:55.976915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:55.977762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:55.978861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:55.979543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:56.389111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:56.412064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-93844586-e2e9-47d1-b2c4-85f918de5338 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.636472 Dec 03 03:36:56.412762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 203/402] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:55 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:56.689167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:56.711637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-51af6589-7e28-43c0-a2dc-83df4870e2c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1547 microversion: 2.1 time: 0.782706 Dec 03 03:36:56.720180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 200/403] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:55 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1547 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:56.735517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:56.755571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:36:56.755571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:36:56.757267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:56.765908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Searching by: {'deleted': False, 'project_id': '0840879b0906445784a83ceb05926684'} {{(pid=94249) get_all /opt/stack/nova/nova/compute/api.py:2829}} Dec 03 03:36:56.782293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:56.785483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:56.785989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:56.786906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:56.787405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:56.799444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:56.823904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:56.824397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:56.825487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:56.825995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:57.102886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.multi_cell_list [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=94249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Dec 03 03:36:57.267678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-74964d3f-6ae3-41ca-a800-874c77ce41eb tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.541314 Dec 03 03:36:57.274293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 204/404] 10.222.0.66 () {58 vars in 1115 bytes} [Thu Dec 3 03:36:56 2020] GET /compute/v2.1/servers => generated 341 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:36:57.285102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:57.285781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:57.293939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:57.294478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:57.295344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:57.295840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:57.499757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:57.542729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:57.566587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:57.568928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4bc73a0d-f9d5-4957-adb5-a82b9e40aaf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.795462 Dec 03 03:36:57.570164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 201/405] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:56 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:57.598550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:57.599561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:57.608306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:57.609010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:57.610019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:57.611662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:57.645075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:57.658660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a1c91886-2567-4e77-9aa5-d0fc17303d9a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1547 microversion: 2.1 time: 0.383044 Dec 03 03:36:57.659986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 205/406] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:57 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1547 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:58.080595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:58.091510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-685ac1bf-ebde-476b-958f-e34c50294076 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.519949 Dec 03 03:36:58.092126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 202/407] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:57 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:58.602364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:58.604724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:58.624107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:58.625307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:58.627084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:58.627640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:58.943533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:58.961349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:58.968840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:58.970845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-411c3722-510a-4402-85d2-164c3cf23c57 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.385315 Dec 03 03:36:58.971700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 206/408] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:58 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:36:59.123057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:59.126886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:59.138447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:59.139097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:59.140054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:59.140566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:59.452532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:36:59.464679 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-596a4e47-f3d9-44dd-86da-ec12d7d86652 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.351107 Dec 03 03:36:59.465516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 203/409] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:36:59 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:36:59.921389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d1c3cf7-8bd2-4619-8d62-1f26121c5b32"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:36:59.926872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:36:59.936891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:59.937663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:59.939949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:36:59.940777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:36:59.996526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:36:59.997206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:00.008889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:00.009400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:00.010570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:00.011085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:00.405129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:00.424314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:00.431486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:00.432735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c972b653-a257-48b3-9f37-b726cadbf9d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.445772 Dec 03 03:37:00.433921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 204/410] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:36:59 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:00.490783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:00.491815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:00.499857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:00.500510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:00.501442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:00.502156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:00.807176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:00.824141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4f1a7a4c-9a6a-4be9-b782-b7876c5339c5 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.343026 Dec 03 03:37:00.826272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 205/411] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:00 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:01.458648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:01.459351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:01.467530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:01.468036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:01.468886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:01.469378 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:01.726429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:01.742348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:01.749127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:01.750394 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-89241530-53c1-4ddc-b246-a696417faed4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.301406 Dec 03 03:37:01.751525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 206/412] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:01 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:01.852449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:01.853489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:01.863723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:01.864732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:01.866078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:01.866634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:02.111224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:02.120282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-268776e2-432f-4a78-bceb-41c0bc876ca9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.278972 Dec 03 03:37:02.120884 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 207/413] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:01 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:02.777103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:02.777777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:02.787095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:02.787620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:02.788964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:02.789472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:03.031625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:03.049393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:03.056572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:03.057944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3353511d-ae8a-44f8-a236-d70da5aac99a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.290173 Dec 03 03:37:03.059007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 208/414] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:02 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:03.144572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:03.145239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:03.153556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:03.154057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:03.154925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:03.155415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:03.393896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:03.403601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dc24e6e2-ed6c-47f7-bb70-1ac4123d87b3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.269481 Dec 03 03:37:03.404241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 209/415] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:03 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:04.083969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:04.084652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:04.092690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:04.093200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:04.094053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:04.095196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:04.361530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:04.378457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:04.385603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:04.387001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-29b0b1f1-86a8-4427-a346-08188a0d67e8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.313765 Dec 03 03:37:04.387587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 210/416] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:04 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:04.427534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:04.428189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:04.435985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:04.436604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:04.437436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:04.437922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:04.669798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:04.679266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4c9f5930-f9af-44ae-840e-1003faab40ab tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.261050 Dec 03 03:37:04.679863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 211/417] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:04 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:05.419562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:05.420809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:05.429973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:05.430801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:05.431732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:05.432292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:05.698877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:05.715845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:05.723276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:05.724513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f89d6ec3-96fd-43a0-af46-313505df539f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.321135 Dec 03 03:37:05.725098 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 212/418] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:05 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:05.735110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:05.735772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:05.743608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:05.744102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:05.744952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:05.745417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:05.992094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:06.001746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f784ee8d-c103-462d-8b94-2548f2b40495 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.275072 Dec 03 03:37:06.002357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 213/419] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:05 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:06.749507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:06.750177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:06.758637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:06.759149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:06.759989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:06.760745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:07.012273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:07.038068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:07.045135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:07.046464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-31f28eea-073b-4a7f-a6a6-7dca6f34401d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.306193 Dec 03 03:37:07.047087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 214/420] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:06 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:07.057622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:07.058297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:07.066092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:07.066738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:07.067572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:07.068063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:07.435089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:07.458630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-53f08f83-7774-4771-a6f1-0a0359d6bad0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.409713 Dec 03 03:37:07.459346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 215/421] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:07 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:08.073293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:08.074645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:08.084635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:08.085262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:08.086498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:08.086990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:08.401580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:08.422070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:08.432325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:08.433635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5092975c-d6fd-4d96-b4ce-aad4d62990d3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.371233 Dec 03 03:37:08.437683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 216/422] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:08 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:08.486985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:08.487674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:08.497685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:08.498192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:08.499075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:08.499568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:08.740266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:08.749035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-30d5fc89-341b-4d98-afd9-ccd286bd9e78 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.274775 Dec 03 03:37:08.749631 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 217/423] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:08 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:09.459603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:09.460300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:09.468164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:09.468997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:09.469596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:09.469996 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:09.923731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a71bc694-91c9-4fc2-9c35-c89fd3f64662 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.011937 Dec 03 03:37:09.925082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 207/424] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:36:59 2020] POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments => generated 194 bytes in 10014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:37:09.936591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:09.937386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:09.948471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:09.949286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:09.950374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:09.951037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:09.952743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:09.974409 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:09.982577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:09.987363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fb43ab4b-18cc-49c0-a814-90d3003e19fc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.538371 Dec 03 03:37:09.988125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 218/425] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:09 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:10.182508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:10.191727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f64a3c83-b3f7-4332-844b-016807824fbf tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.265062 Dec 03 03:37:10.192527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 208/426] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:09 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:11.012640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:11.013315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:11.021927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:11.022477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:11.023321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:11.023830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:11.227034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:11.227931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:11.237467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:11.237971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:11.238861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:11.239345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:11.258210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:11.275422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:11.283357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:11.284609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-19e3f254-8d65-4bdb-96c4-fdad804783ba tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.281339 Dec 03 03:37:11.285207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 219/427] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:11 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:11.515732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:11.525000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-391a1785-cabe-4b79-8d14-15d4647f184f tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.319100 Dec 03 03:37:11.525619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 209/428] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:11 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:12.309074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:12.309741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:12.318377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:12.318889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:12.319785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:12.320279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:12.543704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:12.550546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:12.551227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:12.559116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:12.559626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:12.559770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:12.560461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:12.560958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:12.566722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:12.567930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-73f5b57c-49b2-4cab-9a1a-5854fb007ba2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.267979 Dec 03 03:37:12.568511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 220/429] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:12 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:12.781546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:12.790963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-37003067-e088-4bfa-a6ae-16d7c0301038 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.250489 Dec 03 03:37:12.791586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 210/430] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:12 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:13.591414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:13.592078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:13.600057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:13.600560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:13.601379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:13.601864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:13.815054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:13.815720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:13.824204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:13.824712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:13.825532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:13.826191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:13.826443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:13.843757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:13.850603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:13.851872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-74328062-8eb0-4180-a859-e001ca4a207e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.269611 Dec 03 03:37:13.852475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 221/431] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:13 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:14.049346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:14.058293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5b4cbf93-fcfc-446a-9331-6de4b9268288 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1502 microversion: 2.1 time: 0.252921 Dec 03 03:37:14.058878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 211/432] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:13 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:14.082526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c41a0816-bf0e-463e-b9fd-d3d38c2d052e"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:14.083799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:14.091705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.092218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.093053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.093547 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.163754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] HTTP exception thrown: Cannot 'attach_volume' instance 2846e1b1-6107-4523-a287-f599394f984f while it is in vm_state rescued Dec 03 03:37:14.164346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Returning 409 to user: Cannot 'attach_volume' instance 2846e1b1-6107-4523-a287-f599394f984f while it is in vm_state rescued {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:37:14.165250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5d5156b4-9e10-46dd-9e5a-f2613fe41e5d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093187 Dec 03 03:37:14.165856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 222/433] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:37:14 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 03 03:37:14.180930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:14.181536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:14.190843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.191362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.192219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.192715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.339607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c90a6558-bc0f-4418-a2fd-5850634e6044 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action" status: 202 len: 0 microversion: 2.1 time: 0.168535 Dec 03 03:37:14.340291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 212/434] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:14 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:14.353992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:14.354675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:14.363951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.364479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.365306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.365795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.725667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:14.734460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3e51f69f-d919-4a77-9fa5-6cbf94b15244 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1510 microversion: 2.1 time: 0.389522 Dec 03 03:37:14.736015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 223/435] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:14 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:14.878531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:14.879301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:14.889183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.889689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:14.890562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:14.891618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:15.326896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:15.342777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:15.349704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:15.350949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6135b05d-7413-4a5f-adef-79984a822169 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.482257 Dec 03 03:37:15.351536 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 213/436] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:14 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:15.759273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:15.759863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:15.768511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:15.769011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:15.769849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:15.770355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:15.996385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:16.006227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-35766735-ac33-4e07-9761-6d9ef57b98cd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1510 microversion: 2.1 time: 0.256162 Dec 03 03:37:16.006837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 224/437] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:15 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:16.375179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:16.376654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:16.385320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:16.386120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:16.386998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:16.387487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:16.605081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:16.620755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:16.627873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:16.629161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3ba88f92-9145-4e1b-bec3-86b208422d47 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.263164 Dec 03 03:37:16.629751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 214/438] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:16 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:17.031044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:17.032289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:17.040382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:17.040893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:17.041732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:17.042228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:17.263511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:17.273477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2ef949c3-0288-40f6-8ced-0b7365523804 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1510 microversion: 2.1 time: 0.251692 Dec 03 03:37:17.274085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 225/439] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:17 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:17.654203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:17.655058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:17.663069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:17.663568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:17.664393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:17.664875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:17.897424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:17.913310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:17.919819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:17.921112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c78c7625-3f79-4299-9874-1ab0ddb80932 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.276274 Dec 03 03:37:17.931291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 215/440] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:17 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:18.027213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:18.027889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:18.035958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.036488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:18.037332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.037826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:18.283006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:18.292721 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-09f4b226-d0ee-4f24-8dab-ab7de876b9e0 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1593 microversion: 2.1 time: 0.274510 Dec 03 03:37:18.293321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 226/441] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:18 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1593 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:18.298228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:18.298908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:18.306815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.307316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:18.308151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.308637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:18.316036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a01704f9-7669-41ae-836a-68cec2b1e0ad tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: .version_select at 0x7fe9169ad840>, body: {"pool": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:18.649156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:18.658726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4a93ed33-77c9-4004-a76b-9cd2ad0c4736 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1516 microversion: 2.1 time: 0.369812 Dec 03 03:37:18.659334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 216/442] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:18 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1516 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:18.946668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:18.947340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:18.955706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.956216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:18.957071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:18.957563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:19.365354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:19.380714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:19.388324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:19.389578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-330d55b9-9d4c-4953-a787-9b7bba338db7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.452700 Dec 03 03:37:19.390172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 217/443] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:18 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:20.155684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-fb99c418-2451-47f3-b672-854bc0bb35ff req-c77be5a9-d378-4eae-8938-472c19e63a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "name": "network-vif-plugged", "status": "completed", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:20.165037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:37:20.165037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:37:20.174892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-fb99c418-2451-47f3-b672-854bc0bb35ff req-c77be5a9-d378-4eae-8938-472c19e63a47 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:20.175486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-fb99c418-2451-47f3-b672-854bc0bb35ff req-c77be5a9-d378-4eae-8938-472c19e63a47 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:20.216469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-fb99c418-2451-47f3-b672-854bc0bb35ff req-c77be5a9-d378-4eae-8938-472c19e63a47 service nova] Creating event network-vif-plugged:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:37:20.222965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-fb99c418-2451-47f3-b672-854bc0bb35ff req-c77be5a9-d378-4eae-8938-472c19e63a47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078382 Dec 03 03:37:20.224232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 218/444] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:37:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:37:20.308288 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:20.309303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:20.318787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:20.319334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:20.320158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:20.320653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:20.706815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:20.716450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef546619-2fdc-454f-9acf-cb43ba4c8302 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1516 microversion: 2.1 time: 0.429783 Dec 03 03:37:20.717263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 219/445] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:20 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1516 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:20.727657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:20.728320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:20.736477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:20.736977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:20.737819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:20.738339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:20.999668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a01704f9-7669-41ae-836a-68cec2b1e0ad tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.692969 Dec 03 03:37:21.000360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 227/446] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Dec 3 03:37:18 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:37:21.011121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7384219-5305-4cfc-b1ad-f4c9aef09743"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:21.012393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:21.022180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:21.022716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:21.023566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:21.024058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:21.118661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:21.134857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:21.143095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:21.144363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7bbf815-eded-4467-aadb-f25397c00cd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.426201 Dec 03 03:37:21.144962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 220/447] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:20 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:37:21.155707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'action', calling method: .version_select at 0x7fe9178e6048>, body: {"addFloatingIp": {"address": "172.27.0.58"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:21.157681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:21.166214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:21.166743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:21.167597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:21.168081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:21.247368 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Acquired lock "refresh_cache-75622a80-5890-4275-a3ae-92992d9bd724" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:37:21.766502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4878fadb-66b7-4ded-8d0c-76af1cb10820 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764655 Dec 03 03:37:21.767271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 228/448] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:37:21 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:37:22.169486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:22.170258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:22.179250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:22.179757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:22.180598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:22.181088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:22.832586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:22.851125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:22.861281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:22.863677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0be62721-6fbf-4a86-a975-11aebc3029d4 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1805 microversion: 2.20 time: 0.703527 Dec 03 03:37:22.864334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 229/449] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:22 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1805 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:23.303831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:37:23.319393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d14aa909-91c0-4f8b-a3cc-34fdddae8668 req-40a9f0d2-40d8-4cbe-b4d5-d7a2f408d80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:23.326796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:37:23.326796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:37:23.336959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d14aa909-91c0-4f8b-a3cc-34fdddae8668 req-40a9f0d2-40d8-4cbe-b4d5-d7a2f408d80f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:23.337732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d14aa909-91c0-4f8b-a3cc-34fdddae8668 req-40a9f0d2-40d8-4cbe-b4d5-d7a2f408d80f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:23.355986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d14aa909-91c0-4f8b-a3cc-34fdddae8668 req-40a9f0d2-40d8-4cbe-b4d5-d7a2f408d80f service nova] Creating event network-changed:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:37:23.362101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d14aa909-91c0-4f8b-a3cc-34fdddae8668 req-40a9f0d2-40d8-4cbe-b4d5-d7a2f408d80f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053285 Dec 03 03:37:23.363137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 230/450] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:37:23 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:37:23.890191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:23.891056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:23.899383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:23.899802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:23.900853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:23.901122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:24.442836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:24.460827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:24.468226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:24.470275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-09bf4f14-7ff3-4f9e-93e8-cafd425d04e7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1792 microversion: 2.20 time: 0.589592 Dec 03 03:37:24.470963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 231/451] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:37:23 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1792 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:37:25.004171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Updating instance_info_cache with network_info: [{"id": "28667180-06cd-43b5-8695-54a0887da00a", "address": "fa:16:3e:3b:4a:12", "network": {"id": "330d9e4d-fc33-4815-90f4-d12bca58f5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587950612-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0840879b0906445784a83ceb05926684", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap28667180-06", "ovs_interfaceid": "28667180-06cd-43b5-8695-54a0887da00a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:37:25.017792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Releasing lock "refresh_cache-75622a80-5890-4275-a3ae-92992d9bd724" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:37:25.019211 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e2ee1f69-8ba5-48b6-b96f-5debbf2611b7 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action" status: 202 len: 0 microversion: 2.1 time: 3.872659 Dec 03 03:37:25.019471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 221/452] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:21 2020] POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action => generated 0 bytes in 3874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 03:37:25.034714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6c0a4ee0-6282-48df-adbb-60dab02fe29b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: .version_select at 0x7fe917448d90>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1110683053", "description": "tempest-TestMinimumBasicScenario-1110683053 description"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:25.410049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6c0a4ee0-6282-48df-adbb-60dab02fe29b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.385475 Dec 03 03:37:25.410854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 232/453] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Dec 3 03:37:25 2020] POST /compute/v2.1/os-security-groups => generated 257 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:37:25.428540 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b1bda0f4-ce7a-47f3-9f74-9e0913ab27e2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: .version_select at 0x7fe915752048>, body: {"security_group_rule": {"parent_group_id": "56bce161-4a34-481a-a18f-9044a48391f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:25.648772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b1bda0f4-ce7a-47f3-9f74-9e0913ab27e2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.230082 Dec 03 03:37:25.649431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 222/454] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:37:25 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:37:25.666377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-af539083-af35-4f5e-95df-6cd8b46bb02a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'create', calling method: .version_select at 0x7fe9174480d0>, body: {"security_group_rule": {"parent_group_id": "56bce161-4a34-481a-a18f-9044a48391f5", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:25.887702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-af539083-af35-4f5e-95df-6cd8b46bb02a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.231219 Dec 03 03:37:25.888359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 233/455] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:37:25 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:37:25.905623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1110683053"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:25.906220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:25.915889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:25.916399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:25.917235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:25.917724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:26.155168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.network.security_group_api [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Adding security group 56bce161-4a34-481a-a18f-9044a48391f5 to port 28667180-06cd-43b5-8695-54a0887da00a Dec 03 03:37:26.866494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5527026e-2740-4f50-90a9-d9dda2a7bbe8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action" status: 202 len: 0 microversion: 2.1 time: 0.970312 Dec 03 03:37:26.869777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 223/456] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:25 2020] POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:26.881361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:26.882023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:26.882444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-8f7931cc-85cc-40f5-bb5c-e1f385118253 req-6f1df6db-bdeb-4353-9528-5e91efa80bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:26.892355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:26.892574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:37:26.892574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:37:26.893021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:26.893887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:26.894486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:26.903109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8f7931cc-85cc-40f5-bb5c-e1f385118253 req-6f1df6db-bdeb-4353-9528-5e91efa80bfe service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:26.903878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8f7931cc-85cc-40f5-bb5c-e1f385118253 req-6f1df6db-bdeb-4353-9528-5e91efa80bfe service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:26.924131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-8f7931cc-85cc-40f5-bb5c-e1f385118253 req-6f1df6db-bdeb-4353-9528-5e91efa80bfe service nova] Creating event network-changed:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:37:26.929606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-8f7931cc-85cc-40f5-bb5c-e1f385118253 req-6f1df6db-bdeb-4353-9528-5e91efa80bfe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058410 Dec 03 03:37:26.930358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 234/457] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:37:26 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:37:27.276751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:27.286768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a5c12559-96ac-44e3-80ae-fae6610574d3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1768 microversion: 2.1 time: 0.414900 Dec 03 03:37:27.287371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 224/458] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:26 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1768 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:28.120093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:28.120730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:28.128791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:28.129291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:28.130118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:28.130667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:28.396490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5dd5a936-5547-4290-aae3-f133b4db5d0a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-volume_attachments/9f8d2d64-188f-435d-a6ee-f59ec5e66c39" status: 202 len: 0 microversion: 2.1 time: 0.286949 Dec 03 03:37:28.397123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 235/459] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:37:28 2020] DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/os-volume_attachments/9f8d2d64-188f-435d-a6ee-f59ec5e66c39 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:29.681098 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:29.682289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:29.690745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:29.691256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:29.692090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:29.692585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:29.763262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lazy-loading 'flavor' on Instance uuid 2846e1b1-6107-4523-a287-f599394f984f {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:37:30.023370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fb9cfbba-018a-4231-bfdd-a69cf2b8b9a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action" status: 200 len: 32 microversion: 2.1 time: 0.352695 Dec 03 03:37:30.024301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 225/460] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:29 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 03:37:30.040965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:30.041751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:30.050359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:30.050920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:30.051769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:30.052265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:30.606068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:30.619686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d38baaa3-6f0b-4316-b796-1a99d787a4a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.589130 Dec 03 03:37:30.620699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 236/461] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:30 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:30.718116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4dd148df-0922-46c1-8e26-a2860eb1d176 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:30.727196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dd148df-0922-46c1-8e26-a2860eb1d176 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:30.727746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4dd148df-0922-46c1-8e26-a2860eb1d176 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:30.793710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4dd148df-0922-46c1-8e26-a2860eb1d176 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Going to try to stop instance {{(pid=94249) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 03 03:37:30.873528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4dd148df-0922-46c1-8e26-a2860eb1d176 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 202 len: 0 microversion: 2.1 time: 0.164788 Dec 03 03:37:30.874199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 226/462] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:30 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:30.888468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:30.889199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:30.897862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:30.898400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:30.899240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:30.899723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:31.259024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:31.269314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6490ac6a-3cad-493a-a788-1388990c1e72 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.390420 Dec 03 03:37:31.269921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 237/463] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:30 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:31.646115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:31.646843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:31.655079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:31.655595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:31.657520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:31.658026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:31.896565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:31.905843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6c8dbe6a-55d1-44d3-8638-579e560522ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.270831 Dec 03 03:37:31.906464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 227/464] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:31 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:32.293332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:32.293998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:32.303141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:32.303647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:32.304487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:32.304983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:32.524243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:32.533006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d61fa020-0990-410a-bfa7-1c747c533861 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.248813 Dec 03 03:37:32.533591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 238/465] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:32 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:32.930501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:32.931486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:32.944430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:32.946162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:32.947067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:32.947571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:33.174316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:33.191381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-940b1938-999d-418d-b991-feb834626cea tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.271084 Dec 03 03:37:33.198332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 228/466] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:32 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:33.557561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:33.558224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:33.566544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:33.567042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:33.567865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:33.568355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:33.787450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:33.796395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-81e1d5ee-87d2-4f25-aa8b-00dcab36e395 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.248428 Dec 03 03:37:33.797521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 239/467] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:33 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:34.215299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:34.215960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:34.224863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:34.225362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:34.226191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:34.226699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:34.447273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:34.457266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef3d57d7-e136-4aad-9005-af1f603d7567 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.250982 Dec 03 03:37:34.457886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 229/468] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:34 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:34.821276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:34.821934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:34.829716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:34.830218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:34.831099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:34.832323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:35.056860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:35.065564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c28e66ae-b1cc-4631-abe7-9d43d63e713c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.254077 Dec 03 03:37:35.066925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 240/469] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:34 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:35.482039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:35.482694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:35.490849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:35.491357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:35.492198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:35.492695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:35.723172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:35.731663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2cfed4ad-76d9-4951-9303-6f34c6e01e05 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.258964 Dec 03 03:37:35.732301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 230/470] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:35 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:36.090758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:36.091438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:36.100380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:36.100890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:36.101729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:36.102220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:36.322778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:36.332738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-767a8a60-e355-4ae4-8535-53b6aab1767e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.250941 Dec 03 03:37:36.333346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 241/471] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:36 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:36.756193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:36.756850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:36.764970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:36.765469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:36.766311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:36.766796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:36.985476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:36.996086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c5f6929d-f50d-41af-9230-d4e29fe96285 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.249402 Dec 03 03:37:36.996684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 231/472] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:36 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:37.356690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:37.357354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:37.365350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:37.365857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:37.366712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:37.367204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:37.591309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:37.601014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-08fc9595-0612-4fbd-b30f-a91e25954c34 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.253968 Dec 03 03:37:37.601610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 242/473] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:37 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:38.020752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:38.021413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:38.029365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:38.029866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:38.030762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:38.031198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:38.249836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:38.260015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7cfcf25f-fe63-47c4-8a2c-76be6313c5dc tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.248559 Dec 03 03:37:38.260855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 232/474] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:38 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:38.624988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:38.625811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:38.634977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:38.635483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:38.636568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:38.637056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:38.858114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:38.867491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2660b658-5693-4f07-8f25-9b4f8a5532c6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.252040 Dec 03 03:37:38.868077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 243/475] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:38 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:39.283447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:39.284116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:39.292664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:39.293175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:39.294015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:39.294552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:39.697949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:39.707643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b2bb6ba7-136e-4fa2-8897-05b9a560d8dd tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.433267 Dec 03 03:37:39.708244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 233/476] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:39 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:39.891159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:39.891823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:39.899846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:39.900348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:39.901178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:39.901668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:40.458405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:40.467592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0dbffdbc-fdf1-4070-b8b6-128d2028b4ae tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.585901 Dec 03 03:37:40.468180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 244/477] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:39 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:40.730751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:40.731340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:40.739369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:40.739872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:40.740703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:40.741193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:40.960774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:40.970073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d315d6ab-dc57-44cc-9f10-f204eaf1e1ac tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.248655 Dec 03 03:37:40.970691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 234/478] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:40 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:41.492191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:41.492778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:41.500604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:41.501105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:41.501933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:41.502447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:41.729156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:41.738649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d2477299-a6a7-44f6-982a-4c7313e9e516 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.255903 Dec 03 03:37:41.739239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 245/479] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:41 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:41.994696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:41.995366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:42.004326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:42.004825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:42.005652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:42.006142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:42.224030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:42.234170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-552d31ce-6204-428e-b9da-4079f5bcff14 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.249345 Dec 03 03:37:42.234865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 235/480] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:41 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:42.761956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:42.762648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:42.771107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:42.771610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:42.772458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:42.772943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:42.997152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:43.007137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-87a7a67d-f234-40fb-b716-198ef00ae3fb tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.254780 Dec 03 03:37:43.007733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 246/481] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:42 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:43.258881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:43.259554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:43.267681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:43.268169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:43.269054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:43.269630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:43.490557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:43.499847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b3dabe06-e0eb-4a64-935c-973ca1300a01 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.250721 Dec 03 03:37:43.500482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 236/482] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:43 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:44.030699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:44.031359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:44.039557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:44.040013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:44.040848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:44.041341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:44.262577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:44.271785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fdae5e00-ca01-4c36-9316-d194140eb6ba tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.250229 Dec 03 03:37:44.272382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 247/483] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:44 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:44.523147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:44.523810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:44.531715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:44.532227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:44.533055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:44.533555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:44.757185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:44.766830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f4e7734-3269-4510-ae14-309e84e001a8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.253309 Dec 03 03:37:44.767431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 237/484] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:44 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:45.295609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:45.296280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:45.304895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:45.305444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:45.306315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:45.306813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:45.531289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:45.540861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27cc420d-c687-4c44-85ce-e9044e1a7ede tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1679 microversion: 2.1 time: 0.254568 Dec 03 03:37:45.541446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 248/485] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:45 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:45.790249 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:45.790924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:45.798817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:45.799319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:45.800696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:45.801348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:46.028134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:46.037677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f3bd4e58-f0df-4ca7-aa15-08dc9571c216 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.256829 Dec 03 03:37:46.038223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 238/486] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:45 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:46.565153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:46.565977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:46.573906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:46.574459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:46.575290 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:46.575770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:46.932229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:46.941186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1cf34a22-3244-4de0-b4b0-8d157c152081 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1656 microversion: 2.1 time: 0.385071 Dec 03 03:37:46.941776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 249/487] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:46 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1656 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:46.964432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d7e7986-4b1f-421b-b2af-43631670bcd5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:46.973117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e7986-4b1f-421b-b2af-43631670bcd5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:46.973628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e7986-4b1f-421b-b2af-43631670bcd5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:47.042052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d7e7986-4b1f-421b-b2af-43631670bcd5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Going to try to start instance {{(pid=94249) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 03 03:37:47.060764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:47.061433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:47.069292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:47.069802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:47.070710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:47.071206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:47.121991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d7e7986-4b1f-421b-b2af-43631670bcd5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action" status: 202 len: 0 microversion: 2.1 time: 0.167377 Dec 03 03:37:47.122702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 239/488] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:46 2020] POST /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:47.137478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:47.138193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:47.147431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:47.147935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:47.148770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:47.149255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:47.417373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:47.426806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ba43020-3d0d-47f1-8201-437381e05624 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.374980 Dec 03 03:37:47.427406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 250/489] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:47 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:47.574693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:47.584204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-800ef90b-de4d-4ed6-bba9-cc7a0aef601e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1665 microversion: 2.1 time: 0.456818 Dec 03 03:37:47.585071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 240/490] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:47 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1665 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:48.450048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:48.450662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:48.459022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:48.459528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:48.460348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:48.460832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:48.609127 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:48.609787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:48.617636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:48.618132 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:48.618996 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:48.619482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:48.685688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:48.697077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2174cdb3-07f3-49e5-8d85-9ca2a29f73c7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.256375 Dec 03 03:37:48.697697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 251/491] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:48 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:48.843458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:48.853152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d0ae713-c8e3-4024-ac4b-a70d8e3ca7df tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1665 microversion: 2.1 time: 0.253124 Dec 03 03:37:48.853749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 241/492] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:48 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1665 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:37:49.722771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:49.723436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:49.731301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.731807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:49.732631 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.733123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:49.877236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:49.878555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:49.886805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.887319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:49.888160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.888649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:49.955131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:49.969317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a70ffa39-3b52-476f-9879-1edfb7de7a09 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.255891 Dec 03 03:37:49.970441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 252/493] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:49 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:49.986871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:37:49.988041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:49.996071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.996582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:49.997425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:49.997918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:50.127693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:50.137998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d5b61548-5ed9-430d-b70b-65ba485acd2f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1669 microversion: 2.1 time: 0.270221 Dec 03 03:37:50.138794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 242/494] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:49 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:50.155260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2d4dd106-3adf-4017-a672-b0427090fbe1 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action" status: 202 len: 0 microversion: 2.1 time: 0.183002 Dec 03 03:37:50.155956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 253/495] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:37:49 2020] POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:37:50.171041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:50.171715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:50.185666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:50.186179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:50.187057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:50.187564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:50.587591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:50.598131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8ce0cb6f-e8aa-4fbc-b949-a1f993df5cb9 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1760 microversion: 2.1 time: 0.435991 Dec 03 03:37:50.598773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 243/496] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:50 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1760 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:50.994744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:50.995572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:51.003712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:51.004200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:51.005047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:51.005565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:51.532004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:51.542120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7ed1dfc-1337-4746-9642-aca76d1ba117 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.557605 Dec 03 03:37:51.542747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 254/497] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:50 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:51.622783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:51.623444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:51.631634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:51.632136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:51.633014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:51.633500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:51.994443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:52.004068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fc2cad38-71d7-49c4-a402-fa741df4f33c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.390583 Dec 03 03:37:52.004657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 244/498] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:51 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:52.565156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:52.565917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:52.573703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:52.574209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:52.575086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:52.575584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:52.792006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:52.802314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-23a35495-33a9-456d-9ed3-90c72f847552 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.246218 Dec 03 03:37:52.802923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 255/499] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:52 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:53.028940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:53.029529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:53.038461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:53.038960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:53.039780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:53.040265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:53.263982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:53.274417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-26d919ed-399e-4b67-91df-cb9ca7cbb46c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.254626 Dec 03 03:37:53.275005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 245/500] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:53 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:53.826483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:53.827153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:53.835367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:53.835920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:53.836772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:53.837266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:54.062741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:54.072769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1ee04576-22e4-4872-b4da-3d87c6897e92 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.255556 Dec 03 03:37:54.073356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 256/501] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:53 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:54.299653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:54.300916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:54.308872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:54.309383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:54.310221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:54.310741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:54.531263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:54.541262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-40354af3-d543-4e02-a843-5895d06df21c tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.250819 Dec 03 03:37:54.541820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 246/502] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:54 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:55.095938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:55.096656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:55.105181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:55.105667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:55.106526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:55.107017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:55.330640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:55.340556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5053a893-1c16-40fc-b09f-6cd56ee868f4 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.253669 Dec 03 03:37:55.341144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 257/503] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:55 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:55.564150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:55.564816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:55.572812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:55.573312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:55.574133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:55.574644 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:55.799248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:55.809863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e1ec641b-d2a4-4d4c-8d2c-33925abc3d93 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.254781 Dec 03 03:37:55.810487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 247/504] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:55 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:56.364490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:56.365161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:56.373045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:56.373555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:56.374417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:56.374907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:56.595832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:56.605671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7ec06f26-e276-47b3-b7ac-e303c1212737 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.250422 Dec 03 03:37:56.606281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 258/505] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:56 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:56.834017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:56.834708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:56.842612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:56.843124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:56.843954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:56.844485 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:57.065688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:57.075121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d63a205f-1618-4eed-abd8-37eedd027f4d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.250816 Dec 03 03:37:57.075715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 248/506] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:56 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:57.629894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:57.630588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:57.638757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:57.639254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:57.640093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:57.640577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:57.863250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:57.872658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b736b912-bc21-4b51-87c5-c36d86ccfa5b tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.252904 Dec 03 03:37:57.873248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 259/507] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:57 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:58.099184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:58.099853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:58.107737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:58.108244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:58.109072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:58.109559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:58.329058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:58.339191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-95815ddc-df4b-424d-aa54-3cb39870e878 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.249954 Dec 03 03:37:58.339781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 249/508] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:58 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:58.898053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:58.898769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:58.906617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:58.907125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:58.907957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:58.908450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:59.129517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:59.139124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0f0a6f42-857e-425f-9580-741e54d0e3ec tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.251417 Dec 03 03:37:59.139725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 260/509] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:58 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:37:59.363968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:37:59.364633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:37:59.372472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:59.372982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:59.373812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:37:59.374349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:37:59.599210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:37:59.608535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3b464e5f-449e-47a8-a83c-aca8dfea7a09 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.254382 Dec 03 03:37:59.609117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 250/510] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:37:59 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:00.163600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:00.164262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:00.172148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:00.172654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:00.173478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:00.173964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:00.392017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:00.401535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-371c4008-3948-44fe-b62c-b39bdcb73750 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.247787 Dec 03 03:38:00.402131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 261/511] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:00 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:00.634017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:00.634724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:00.642948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:00.644092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:00.645108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:00.645603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:00.869276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:00.879222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-70260d8c-c1f1-4272-acca-324281b6ed6a tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.254351 Dec 03 03:38:00.879808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 251/512] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:00 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:01.425860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:01.426600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:01.434421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:01.434923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:01.435749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:01.436233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:01.665009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:01.674281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6a25c8cd-4550-4309-bbff-9a43a7f1b125 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.257809 Dec 03 03:38:01.675610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 262/513] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:01 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:01.903833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:01.904423 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:01.913366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:01.913870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:01.914745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:01.915234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:02.138006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:02.148143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-76343068-7c20-46e4-9fc9-e267abfb51c8 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1765 microversion: 2.1 time: 0.254835 Dec 03 03:38:02.148718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 252/514] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:01 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1765 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:02.698775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:02.699430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:02.708009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:02.708502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:02.709320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:02.709804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:02.944224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:02.953767 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-769016aa-1bde-4193-a7f4-112904730949 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.264592 Dec 03 03:38:02.954529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 263/515] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:02 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:03.171576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:03.172237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:03.181176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:03.181682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:03.182551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:03.183147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:03.501529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:03.511702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b0cc4d06-63e8-42ed-bd71-06ad0cc18021 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1768 microversion: 2.1 time: 0.349327 Dec 03 03:38:03.512296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 253/516] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:03 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1768 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:03.977197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:03.977861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:03.985612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:03.986116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:03.987108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:03.987725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:04.214866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:04.224949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a8131f6e-89bb-4cb9-a566-8834a5e816b8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1568 microversion: 2.1 time: 0.257147 Dec 03 03:38:04.225555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 264/517] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:03 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:05.248557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:05.249215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:05.258055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.258604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.259422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.259908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.481105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:05.491087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3d07e2af-0042-4338-bfcb-ab966bea9bcb tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1548 microversion: 2.1 time: 0.251691 Dec 03 03:38:05.491677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 254/518] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:05 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:05.514064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:05.514632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:05.522596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.523100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.523963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.524456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.704117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] HTTP exception thrown: Cannot 'detach_volume' instance 2846e1b1-6107-4523-a287-f599394f984f while it is in vm_state rescued Dec 03 03:38:05.704778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Returning 409 to user: Cannot 'detach_volume' instance 2846e1b1-6107-4523-a287-f599394f984f while it is in vm_state rescued {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:38:05.706194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ccb34791-e8a7-4d5a-805c-b757d77c3954 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments/e7384219-5305-4cfc-b1ad-f4c9aef09743" status: 409 len: 152 microversion: 2.1 time: 0.201334 Dec 03 03:38:05.707086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 265/519] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:38:05 2020] DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments/e7384219-5305-4cfc-b1ad-f4c9aef09743 => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 03 03:38:05.721119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:05.722577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:05.730364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.730866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.731739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.732175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.874772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fe91f5d9-5990-4221-99de-49ee1f6000d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action" status: 202 len: 0 microversion: 2.1 time: 0.162425 Dec 03 03:38:05.876322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 255/520] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:38:05 2020] POST /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:05.890271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:05.890957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:05.899691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.900200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:05.901052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:05.901543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:06.258547 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:06.268888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-47013d4c-576e-42b5-bad1-8db0057324a3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1556 microversion: 2.1 time: 0.387405 Dec 03 03:38:06.270137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 266/521] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:05 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1556 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:06.335383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:06.335959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:06.344129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:06.344642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:06.345485 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:06.345976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:06.426075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-00e9a37f-4cde-4aa3-9a28-d6d49e173c95 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments/a5ae205c-5970-4ddb-b2ea-95c0add1e6d0" status: 200 len: 194 microversion: 2.20 time: 0.101954 Dec 03 03:38:06.426765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 256/522] 10.222.0.66 () {60 vars in 1444 bytes} [Thu Dec 3 03:38:06 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments/a5ae205c-5970-4ddb-b2ea-95c0add1e6d0 => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:38:06.561871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:06.562658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:06.571677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:06.572177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:06.573031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:06.573533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:06.843337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ba9d6ba9-8e44-4468-8a31-77557217a9ce tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments/a5ae205c-5970-4ddb-b2ea-95c0add1e6d0" status: 202 len: 0 microversion: 2.20 time: 0.300846 Dec 03 03:38:06.844272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 267/523] 10.222.0.66 () {60 vars in 1447 bytes} [Thu Dec 3 03:38:06 2020] DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13/os-volume_attachments/a5ae205c-5970-4ddb-b2ea-95c0add1e6d0 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:38:07.293358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:07.294024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:07.302559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:07.303064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:07.303882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:07.304368 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:07.524255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:07.533592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8080d7a1-05e9-424f-84ee-50255e689980 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1556 microversion: 2.1 time: 0.249809 Dec 03 03:38:07.534652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 257/524] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:07 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:08.568102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:08.569373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:08.578200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:08.578866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:08.579672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:08.580161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:09.038548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:09.048741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9608ea64-df00-4846-9c36-f3f1d70a4417 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1556 microversion: 2.1 time: 0.499649 Dec 03 03:38:09.049535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 268/525] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:08 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1556 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:09.180729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:09.181292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:09.189792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:09.191366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:09.192315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:09.192807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:09.292277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:38:09.412685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0857c394-62eb-4ecd-a95e-8e21a9f5b973 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 204 len: 0 microversion: 2.20 time: 0.245117 Dec 03 03:38:09.413320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 258/526] 10.222.0.66 () {60 vars in 1270 bytes} [Thu Dec 3 03:38:09 2020] DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 03:38:09.427241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:09.427907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:09.435760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:09.436945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:09.437785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:09.438299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:09.666871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:09.681347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:09.687987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:09.689877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-25ae504e-652f-44c7-8217-8c7aa0023c06 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.271944 Dec 03 03:38:09.690653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 269/527] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:09 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:10.073739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:10.074946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:10.083220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.083735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.084595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.085094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.315942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:10.325464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9fd96e58-e765-4f68-9c11-bd74d06945c3 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1562 microversion: 2.1 time: 0.261698 Dec 03 03:38:10.326015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 259/528] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:10 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:10.453213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:10.453766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:10.462868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.463384 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.464219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.464713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.715196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:10.715874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:10.724589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.725099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.725947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:10.726473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:10.734458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f7988218-4501-4b21-b59e-b0255c7bb600 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments/e7384219-5305-4cfc-b1ad-f4c9aef09743" status: 202 len: 0 microversion: 2.1 time: 0.290111 Dec 03 03:38:10.735212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 270/529] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:38:10 2020] DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f/os-volume_attachments/e7384219-5305-4cfc-b1ad-f4c9aef09743 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:10.952068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:10.967053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:10.974189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:10.975433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-40ce5517-de0d-4247-bd45-0e3f77e8f5d0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.269592 Dec 03 03:38:10.976012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 260/530] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:10 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:11.827230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-723f34ce-867b-4783-ad50-9d35f3030102 req-f312bb78-9caf-490c-8aa5-7360e28896d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "name": "network-vif-unplugged", "status": "completed", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:11.835340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:11.835340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:11.844537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-723f34ce-867b-4783-ad50-9d35f3030102 req-f312bb78-9caf-490c-8aa5-7360e28896d5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:11.845045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-723f34ce-867b-4783-ad50-9d35f3030102 req-f312bb78-9caf-490c-8aa5-7360e28896d5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:11.866176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-723f34ce-867b-4783-ad50-9d35f3030102 req-f312bb78-9caf-490c-8aa5-7360e28896d5 service nova] Creating event network-vif-unplugged:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:38:11.871551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-723f34ce-867b-4783-ad50-9d35f3030102 req-f312bb78-9caf-490c-8aa5-7360e28896d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054159 Dec 03 03:38:11.872450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 271/531] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:11 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:12.000511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:12.001349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:12.010140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:12.010773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:12.011957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:12.012528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:12.478770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:12.493428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:12.499999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:12.501203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a09fc9ca-bf9e-4388-a6b6-0df2bf8c90de tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1720 microversion: 2.20 time: 0.510056 Dec 03 03:38:12.501793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 261/532] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:11 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1720 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:13.287587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-dae44435-21a6-428b-91ca-8675b8f6a478 req-ae35d93d-bf40-4e09-b37b-dfcd4858afdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428a81d4-be89-4e0b-8c3e-ec4ca703cd13", "name": "network-vif-deleted", "tag": "c3f23d04-82b9-44c8-8757-e196aa111f7e"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:13.295787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:13.295787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:13.308171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-dae44435-21a6-428b-91ca-8675b8f6a478 req-ae35d93d-bf40-4e09-b37b-dfcd4858afdd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:13.309002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-dae44435-21a6-428b-91ca-8675b8f6a478 req-ae35d93d-bf40-4e09-b37b-dfcd4858afdd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:13.336275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-dae44435-21a6-428b-91ca-8675b8f6a478 req-ae35d93d-bf40-4e09-b37b-dfcd4858afdd service nova] Creating event network-vif-deleted:c3f23d04-82b9-44c8-8757-e196aa111f7e for instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 on hv-cinder-74915 Dec 03 03:38:13.342339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-dae44435-21a6-428b-91ca-8675b8f6a478 req-ae35d93d-bf40-4e09-b37b-dfcd4858afdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067268 Dec 03 03:38:13.343227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 272/533] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:13 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:13.537765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:13.539422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:13.548097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:13.550065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:13.551147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:13.552435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:13.633281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:13.633796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:13.634354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lazy-loading 'fault' on Instance uuid 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:38:13.727317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:13.743977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:13.750973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:13.752192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-94b5df7e-4655-43a6-9046-1c4992eaae9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 200 len: 1370 microversion: 2.20 time: 0.224519 Dec 03 03:38:13.753664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 262/534] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:13 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:14.778926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:14.779701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:14.788947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:14.789723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:14.790611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:14.791109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:14.847838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. Dec 03 03:38:14.848484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:38:14.849406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2cfe635e-d58b-438e-81db-729b12de58a0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 404 len: 111 microversion: 2.20 time: 0.080759 Dec 03 03:38:14.850021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 273/535] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:14 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 03 03:38:14.865189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-151f47c1-c76a-4a13-99e4-538b21f336f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '.version_select at 0x7fe915752d08>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:14.875131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: ERROR oslo.messaging._drivers.impl_rabbit [None req-151f47c1-c76a-4a13-99e4-538b21f336f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [9a3d6598-3d3e-4a8f-8755-6e6842cde14a] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 03 03:38:15.774100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:15.774720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:15.782576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:15.783088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:15.783936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:15.785487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:15.857259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:38:15.895268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [None req-151f47c1-c76a-4a13-99e4-538b21f336f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [9a3d6598-3d3e-4a8f-8755-6e6842cde14a] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41904. Dec 03 03:38:15.914750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-151f47c1-c76a-4a13-99e4-538b21f336f2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730451375" status: 204 len: 0 microversion: 2.20 time: 1.059590 Dec 03 03:38:15.915487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 263/536] 10.222.0.66 () {60 vars in 1249 bytes} [Thu Dec 3 03:38:14 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730451375 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 03:38:15.988479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7afb2ed-d671-4254-8acd-51071d32fbef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "DELETE /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 204 len: 0 microversion: 2.1 time: 0.223060 Dec 03 03:38:15.989470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 274/537] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:38:15 2020] DELETE /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:38:16.003995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:16.004768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:16.014396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:16.015013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:16.015943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:16.016483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:16.246845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:16.255934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d099c2ae-3680-429e-8f62-59c1f4ca41b9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1508 microversion: 2.1 time: 0.261946 Dec 03 03:38:16.256524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 264/538] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:15 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:17.280154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:17.280898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:17.290168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:17.290705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:17.291542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:17.292027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:17.314110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: .version_select at 0x7fe916a6a158>, body: {"keypair": {"name": "tempest-keypair-1937417455"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:17.344568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:17.349837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:17.483807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:17.488584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:17.502075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6f6017fa-2120-4f78-90f4-e3dc7c00ba40 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.197331 Dec 03 03:38:17.503965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 265/539] 10.222.0.66 () {62 vars in 1189 bytes} [Thu Dec 3 03:38:17 2020] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 03 03:38:17.514019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:17.524352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7734811a-3e85-4a35-942b-9ff9700877a7 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1508 microversion: 2.1 time: 0.253880 Dec 03 03:38:17.525168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 275/540] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:17 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:18.548478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:18.550340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:18.558747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:18.559259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:18.560082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:18.560768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:19.229357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:19.239077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-416538f3-a7b0-4e6c-b207-de31927c75aa tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1508 microversion: 2.1 time: 0.700357 Dec 03 03:38:19.239864 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 266/541] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:18 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1508 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:19.791800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-e2c35326-47a3-445a-8d82-e299a7f604b4 req-61f2f812-fa12-48ab-b575-d3bdf3907469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9955eb83-6d7f-4770-a851-4c648eda7deb", "name": "network-vif-unplugged", "status": "completed", "tag": "8da2ef35-41d3-42dc-8daf-5e6b3c260f36"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:19.799717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:19.799717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:19.809915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e2c35326-47a3-445a-8d82-e299a7f604b4 req-61f2f812-fa12-48ab-b575-d3bdf3907469 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:19.810456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e2c35326-47a3-445a-8d82-e299a7f604b4 req-61f2f812-fa12-48ab-b575-d3bdf3907469 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:19.835263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-e2c35326-47a3-445a-8d82-e299a7f604b4 req-61f2f812-fa12-48ab-b575-d3bdf3907469 service nova] Creating event network-vif-unplugged:8da2ef35-41d3-42dc-8daf-5e6b3c260f36 for instance 9955eb83-6d7f-4770-a851-4c648eda7deb on hv-cinder-74915 Dec 03 03:38:19.840415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-e2c35326-47a3-445a-8d82-e299a7f604b4 req-61f2f812-fa12-48ab-b575-d3bdf3907469 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058868 Dec 03 03:38:19.841364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 276/542] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:19 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:20.263690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:20.264404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:20.273461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:20.273970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:20.274871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:20.275371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:20.527123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:20.536450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-029c2354-bc38-4329-9eff-11647d94f747 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1508 microversion: 2.1 time: 0.283228 Dec 03 03:38:20.537056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 267/543] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:20 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:20.538998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-738995253", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29e6beb-dbdd-4360-87a0-1178c03113fb"}], "security_groups": [{"name": "tempest-securitygroup--528048183"}], "key_name": "tempest-keypair-1937417455", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:20.683051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] validate_networks() for [('e29e6beb-dbdd-4360-87a0-1178c03113fb', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:38:21.570213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:21.570934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:21.579469 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:21.579986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:21.580883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:21.582035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:22.209315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:22.217027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:38:22.217626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:38:22.218578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:38:22.219615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:38:22.220292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:38:22.223397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ade2a22-80b9-4691-87bc-0cf93f3438d0 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 200 len: 1508 microversion: 2.1 time: 0.663726 Dec 03 03:38:22.232182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 268/544] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:21 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:22.235505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:22.236138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:22.237157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:22.237902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:22.257554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:22.262133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Getting quotas for user 797715e424754a368052bb6405c5f5bb and project 3eb64f2deda143e78ec3cd403b83d6ee. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:22.274140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:38:22.276900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:38:22.291188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-bb1a1c13-a13b-425e-8822-de1c1019a588 req-0d2321e0-6b17-440a-a4ab-250808af804d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9955eb83-6d7f-4770-a851-4c648eda7deb", "name": "network-vif-deleted", "tag": "8da2ef35-41d3-42dc-8daf-5e6b3c260f36"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:22.299013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:22.299013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:22.310327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-bb1a1c13-a13b-425e-8822-de1c1019a588 req-0d2321e0-6b17-440a-a4ab-250808af804d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:22.310979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-bb1a1c13-a13b-425e-8822-de1c1019a588 req-0d2321e0-6b17-440a-a4ab-250808af804d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:22.330621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4c8b0f54-13e3-4d5e-9f2c-003fec282eee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.802457 Dec 03 03:38:22.331951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 277/545] 10.222.0.66 () {62 vars in 1178 bytes} [Thu Dec 3 03:38:20 2020] POST /compute/v2.1/servers => generated 401 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 03 03:38:22.337072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-bb1a1c13-a13b-425e-8822-de1c1019a588 req-0d2321e0-6b17-440a-a4ab-250808af804d service nova] Creating event network-vif-deleted:8da2ef35-41d3-42dc-8daf-5e6b3c260f36 for instance 9955eb83-6d7f-4770-a851-4c648eda7deb on hv-cinder-74915 Dec 03 03:38:22.342608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-bb1a1c13-a13b-425e-8822-de1c1019a588 req-0d2321e0-6b17-440a-a4ab-250808af804d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062328 Dec 03 03:38:22.343422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 269/546] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:22 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:38:22.348799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:22.349479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:22.436372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:22.450981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:22.458087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:22.459293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5526913e-0c36-478b-a8f4-774bdab6dab0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1281 microversion: 2.20 time: 0.120199 Dec 03 03:38:22.460031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 278/547] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:22 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:38:23.250272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:23.251041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 9955eb83-6d7f-4770-a851-4c648eda7deb] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:23.259773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.260282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.261386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.261880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.316762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] HTTP exception thrown: Instance 9955eb83-6d7f-4770-a851-4c648eda7deb could not be found. Dec 03 03:38:23.317430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Returning 404 to user: Instance 9955eb83-6d7f-4770-a851-4c648eda7deb could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:38:23.318368 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fa3e5b3a-ea28-4335-91e4-33ef3c6844f8 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb" status: 404 len: 111 microversion: 2.1 time: 0.077823 Dec 03 03:38:23.318977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 270/548] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:23 2020] GET /compute/v2.1/servers/9955eb83-6d7f-4770-a851-4c648eda7deb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:38:23.333327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:23.333868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:23.342024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.342582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.343418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.343911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.415286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:38:23.484088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:23.484676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:23.493480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.493988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.494896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.495385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.536808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a4f6c9db-778c-4798-bbcb-7e38c8a41e1a tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 204 len: 0 microversion: 2.1 time: 0.212820 Dec 03 03:38:23.537796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 279/549] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:38:23 2020] DELETE /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 03 03:38:23.554882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:23.555787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:23.563516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.564024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.565130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:23.565691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:23.637369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:23.652521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:23.659579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:23.660856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cf47a64c-05ce-41d9-81e7-42b3a15c036e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1333 microversion: 2.20 time: 0.186012 Dec 03 03:38:23.661432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 271/550] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:23 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:24.006289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:24.015362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d932067e-5dfc-45ec-b816-f79da776b693 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.472891 Dec 03 03:38:24.015957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 280/551] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:23 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:24.686093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:24.686817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:24.695780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:24.696275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:24.697107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:24.697592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:25.041070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:25.041657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:25.049948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:25.051071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:25.051879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:25.052380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:25.137411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:25.153433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:25.161077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:25.162420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2ccbfd99-8b49-4e0b-9c0e-340d35ac880a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.485494 Dec 03 03:38:25.163275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 272/552] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:24 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:25.506907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:25.515959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ac1a259d-ad24-43c7-adda-dee11ed098e9 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.484872 Dec 03 03:38:25.516560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 281/553] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:25 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:26.187417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:26.188716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:26.197502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:26.198001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:26.198872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:26.199558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:26.540965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:26.541645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:26.551479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:26.552003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:26.552868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:26.553366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:26.762719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:26.777868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:26.785360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:26.786570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7c6d1c58-5039-4a65-bf08-3619bb6cb46e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.609133 Dec 03 03:38:26.787171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 273/554] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:26 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:26.851321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-84c5f5b8-8280-4734-b09d-325dbb28ecdb req-059525f3-c20c-4f05-a7b1-b8813bfd551b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:26.858716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:26.858716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:26.868588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-84c5f5b8-8280-4734-b09d-325dbb28ecdb req-059525f3-c20c-4f05-a7b1-b8813bfd551b service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:26.869085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-84c5f5b8-8280-4734-b09d-325dbb28ecdb req-059525f3-c20c-4f05-a7b1-b8813bfd551b service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:26.888395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-84c5f5b8-8280-4734-b09d-325dbb28ecdb req-059525f3-c20c-4f05-a7b1-b8813bfd551b service nova] Creating event network-changed:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:38:26.898179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-84c5f5b8-8280-4734-b09d-325dbb28ecdb req-059525f3-c20c-4f05-a7b1-b8813bfd551b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061092 Dec 03 03:38:26.899061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 274/555] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:26 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:38:26.916650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:26.926674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-07fd18b5-01b8-4189-97f7-0c69a8361a45 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.395690 Dec 03 03:38:26.927605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 282/556] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:26 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:27.813615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:27.814508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:27.822965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:27.823472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:27.824306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:27.824809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:27.950541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:27.951311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:27.959973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:27.960485 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:27.961324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:27.961819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:28.317805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:28.336193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:28.342800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:28.343986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5da0e47e-bc8a-4f57-b226-22ffa66fa0bd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.541715 Dec 03 03:38:28.344922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 275/557] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:27 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:28.366559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:28.375475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b0568fb4-25ca-4c08-803b-ce2808ffed60 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.434806 Dec 03 03:38:28.376060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 283/558] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:27 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:29.369516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:29.370180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:29.379254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:29.379766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:29.380609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:29.381146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:29.399889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:29.400556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:29.408486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:29.409099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:29.410038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:29.410555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:29.708555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:29.714915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:29.723634 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:29.724537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7259601b-99d6-4619-ba8d-b240d64e944d tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.334150 Dec 03 03:38:29.725137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 284/559] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:29 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:29.730130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:29.731333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b618dc53-6fa9-4fe9-b9ac-85ce433f1a35 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.372198 Dec 03 03:38:29.731907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 276/560] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:29 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:30.749473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:30.750271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:30.759024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:30.759932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:30.760067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:30.760644 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:30.762534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:30.763157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:30.769804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:30.771373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:30.772584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:30.773437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:31.288938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:31.297894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-768b3ab4-c608-426c-9a01-14dda79211ef tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1522 microversion: 2.1 time: 0.559119 Dec 03 03:38:31.298534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 285/561] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:30 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:31.308956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-7351facd-546d-47fd-93a7-a1bc53bb9128 req-a8ee6125-51db-4392-938c-26bbaab6767c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "name": "network-vif-plugged", "status": "completed", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:31.315649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:31.315649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:31.325417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-7351facd-546d-47fd-93a7-a1bc53bb9128 req-a8ee6125-51db-4392-938c-26bbaab6767c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:31.325918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-7351facd-546d-47fd-93a7-a1bc53bb9128 req-a8ee6125-51db-4392-938c-26bbaab6767c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:31.343630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-7351facd-546d-47fd-93a7-a1bc53bb9128 req-a8ee6125-51db-4392-938c-26bbaab6767c service nova] Creating event network-vif-plugged:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:38:31.349209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-7351facd-546d-47fd-93a7-a1bc53bb9128 req-a8ee6125-51db-4392-938c-26bbaab6767c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049159 Dec 03 03:38:31.349774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 286/562] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:31.403337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:31.418187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:31.424810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:31.425978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6fad994a-14e8-457b-b89f-c63a477ed2a7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.679106 Dec 03 03:38:31.427420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 277/563] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:30 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:31.887271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d2e06c46-4d62-4086-b132-f893ecd892b6 req-9f961b3e-dbc1-4b4b-ae06-9c303fbb7d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2846e1b1-6107-4523-a287-f599394f984f", "name": "network-vif-deleted", "tag": "74dbb841-a018-4b62-93d8-e752de7fcf69"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:31.894726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:31.894726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:31.905579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d2e06c46-4d62-4086-b132-f893ecd892b6 req-9f961b3e-dbc1-4b4b-ae06-9c303fbb7d8a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:31.905971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d2e06c46-4d62-4086-b132-f893ecd892b6 req-9f961b3e-dbc1-4b4b-ae06-9c303fbb7d8a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:31.927803 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d2e06c46-4d62-4086-b132-f893ecd892b6 req-9f961b3e-dbc1-4b4b-ae06-9c303fbb7d8a service nova] Creating event network-vif-deleted:74dbb841-a018-4b62-93d8-e752de7fcf69 for instance 2846e1b1-6107-4523-a287-f599394f984f on hv-cinder-74915 Dec 03 03:38:31.932798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d2e06c46-4d62-4086-b132-f893ecd892b6 req-9f961b3e-dbc1-4b4b-ae06-9c303fbb7d8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056933 Dec 03 03:38:31.933449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 287/564] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:32.025957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:32.026539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:32.034430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.034942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.036465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.037112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.108411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:38:32.227318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2a6cf5f0-3033-4196-b02c-145c3d836b49 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 204 len: 0 microversion: 2.1 time: 0.210915 Dec 03 03:38:32.231216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 278/565] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:38:32 2020] DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:38:32.244197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:32.245078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:32.253523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.254028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.255627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.256103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.324390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:32.325795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:32.341839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.342387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.343250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.343751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.429850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.430391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.430908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lazy-loading 'fault' on Instance uuid 2846e1b1-6107-4523-a287-f599394f984f {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:38:32.536535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:32.545250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31f066eec84417bb9f41ad1b00710ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386b3100fc3542508eb392d2e70ddbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:32.545981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-023afe78-792d-43ae-bd23-8d0999185f99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1675 microversion: 2.1 time: 0.312173 Dec 03 03:38:32.546615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 288/566] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:32 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:32.555057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ceca6acd-4de9-4ff6-aafa-0a21329a7f31 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 200 len: 1312 microversion: 2.1 time: 0.241810 Dec 03 03:38:32.555830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 279/567] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:32 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:32.557663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:32.558414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:32.566144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.566707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.575416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:32.575416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:32.795232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:32.810766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:32.818440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:32.819626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c47fb11d-ef34-4079-b62f-334900e9057c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1406 microversion: 2.20 time: 0.272009 Dec 03 03:38:32.820209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 289/568] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:32 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:33.570137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:33.570849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:33.578268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:33.578957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] [instance: 2846e1b1-6107-4523-a287-f599394f984f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:33.579080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.579541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:33.580391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.580925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:33.587711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.588218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:33.589063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.589555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:33.643007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] HTTP exception thrown: Instance 2846e1b1-6107-4523-a287-f599394f984f could not be found. Dec 03 03:38:33.643678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] Returning 404 to user: Instance 2846e1b1-6107-4523-a287-f599394f984f could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:38:33.644581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-65b9a05d-f99b-49a9-b4ee-50b48afdd024 tempest-ServerRescueNegativeTestJSON-91288956 tempest-ServerRescueNegativeTestJSON-91288956] 10.222.0.66 "GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f" status: 404 len: 111 microversion: 2.1 time: 0.075551 Dec 03 03:38:33.645784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 290/569] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:33 2020] GET /compute/v2.1/servers/2846e1b1-6107-4523-a287-f599394f984f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:38:33.845442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:33.846142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:33.855617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.856117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:33.856968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:33.857467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:34.154244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:34.163925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-545fa91d-3de4-496e-9967-c06118e5f19a tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1675 microversion: 2.1 time: 0.603097 Dec 03 03:38:34.164740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 280/570] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:33 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1675 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:34.605074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:34.621734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:34.628286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:34.629553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a97cebf1-a488-48b9-89f7-ede19a35a026 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1598 microversion: 2.20 time: 0.794471 Dec 03 03:38:34.630784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 291/571] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:38:33 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1598 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:38:34.655398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:34.655941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:34.664611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:34.665217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:34.665949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:34.666470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:34.997976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e04ede2b-1a37-4cac-bc73-2234df69b140 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.351733 Dec 03 03:38:34.998695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 281/572] 10.222.0.66 () {60 vars in 1306 bytes} [Thu Dec 3 03:38:34 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:38:35.202205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:35.203216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:35.217795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:35.222624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:35.224622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:35.225327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:35.895590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:35.905822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-af1dcc12-a081-4e9f-a0f4-fdb360755a53 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1675 microversion: 2.1 time: 0.728319 Dec 03 03:38:35.906607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 292/573] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:35 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1675 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:35.963496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-ab018da1-e5a9-4dfe-9e21-117895af39e1 req-204d8c18-1261-437c-a673-1a3fadc66fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac04b0b-7889-4479-916f-167720d1c630", "name": "network-vif-unplugged", "status": "completed", "tag": "d8950c69-c9f3-48de-8cdb-3a898103e0ea"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:35.971411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:35.971411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:35.981601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ab018da1-e5a9-4dfe-9e21-117895af39e1 req-204d8c18-1261-437c-a673-1a3fadc66fbd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:35.982104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ab018da1-e5a9-4dfe-9e21-117895af39e1 req-204d8c18-1261-437c-a673-1a3fadc66fbd service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:36.001952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-ab018da1-e5a9-4dfe-9e21-117895af39e1 req-204d8c18-1261-437c-a673-1a3fadc66fbd service nova] Creating event network-vif-unplugged:d8950c69-c9f3-48de-8cdb-3a898103e0ea for instance 8ac04b0b-7889-4479-916f-167720d1c630 on hv-cinder-74915 Dec 03 03:38:36.008453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-ab018da1-e5a9-4dfe-9e21-117895af39e1 req-204d8c18-1261-437c-a673-1a3fadc66fbd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056249 Dec 03 03:38:36.009416 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 282/574] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:35 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:36.932341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:36.933657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:36.943940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:36.945545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:36.951892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:36.952680 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:36.971414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:36.972560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:36.980784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:36.981494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:36.982516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:36.983160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:37.127286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f0320bf6-3d7c-4838-bb3a-8fc1ca275d01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.165511 Dec 03 03:38:37.128004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 283/575] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:36 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:37.140824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-be9f7e73-e165-48a8-ab88-290c10956657 req-1f5b7e7a-9497-43cb-94b4-19c1f695ce21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:37.149264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:37.149264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:37.160176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-be9f7e73-e165-48a8-ab88-290c10956657 req-1f5b7e7a-9497-43cb-94b4-19c1f695ce21 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:37.162387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-be9f7e73-e165-48a8-ab88-290c10956657 req-1f5b7e7a-9497-43cb-94b4-19c1f695ce21 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:37.200224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-be9f7e73-e165-48a8-ab88-290c10956657 req-1f5b7e7a-9497-43cb-94b4-19c1f695ce21 service nova] Creating event network-changed:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:38:37.206130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-be9f7e73-e165-48a8-ab88-290c10956657 req-1f5b7e7a-9497-43cb-94b4-19c1f695ce21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076397 Dec 03 03:38:37.207149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 284/576] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:37 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:38.013493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:38.023955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-18132984-8a06-464f-ad90-4e0901dbaf61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1675 microversion: 2.1 time: 1.103064 Dec 03 03:38:38.024594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 293/577] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:36 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1675 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:38.147329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:38.148617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:38.157167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:38.157800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:38.158819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:38.159400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:38.298596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b9b93dd0-d9e7-4929-a7c2-88ab970125ae tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.162015 Dec 03 03:38:38.299332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 285/578] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:38 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:39.048183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:39.048878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:39.057232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:39.057858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:39.058620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:39.059214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:39.315958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:39.317398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:39.326269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:39.326781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:39.327620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:39.328107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:39.454715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8b9b3017-df71-470c-99ee-cd3eb8d533c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.148198 Dec 03 03:38:39.455596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 286/579] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:39 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:39.913648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:39.922968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c504a44d-29f3-4fa9-b510-37122bddc4b7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1675 microversion: 2.1 time: 0.883922 Dec 03 03:38:39.923887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 294/580] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:39 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1675 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:40.475429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:40.477317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:40.492026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:40.496084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:40.497011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:40.497506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:40.637456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-093d590a-dd77-4d3a-9cd9-00276cb8187c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.173276 Dec 03 03:38:40.641670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 287/581] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:40 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:40.899033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-53381a0b-38be-402b-a9f9-a678b9790679 req-477569c7-97a4-4ca4-8fd5-a8b38140232c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac04b0b-7889-4479-916f-167720d1c630", "name": "network-vif-deleted", "tag": "d8950c69-c9f3-48de-8cdb-3a898103e0ea"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:40.906554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:40.906554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:40.916957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-53381a0b-38be-402b-a9f9-a678b9790679 req-477569c7-97a4-4ca4-8fd5-a8b38140232c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:40.917806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-53381a0b-38be-402b-a9f9-a678b9790679 req-477569c7-97a4-4ca4-8fd5-a8b38140232c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:40.940550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-53381a0b-38be-402b-a9f9-a678b9790679 req-477569c7-97a4-4ca4-8fd5-a8b38140232c service nova] Creating event network-vif-deleted:d8950c69-c9f3-48de-8cdb-3a898103e0ea for instance 8ac04b0b-7889-4479-916f-167720d1c630 on hv-cinder-74915 Dec 03 03:38:40.947398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-53381a0b-38be-402b-a9f9-a678b9790679 req-477569c7-97a4-4ca4-8fd5-a8b38140232c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058833 Dec 03 03:38:40.949233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:40.950481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:40.950961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 295/582] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:40 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:40.972103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:40.972916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:40.974209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:40.974977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:41.253067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:41.273299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e76318bc-ca56-45cd-90cd-6b1d415e0884 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 200 len: 1322 microversion: 2.1 time: 0.335864 Dec 03 03:38:41.274602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 288/583] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:40 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:41.664437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:41.667951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:41.683761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:41.685076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:41.686109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:41.686848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:41.855749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f1fa6802-2200-474b-971f-dbda82a50fd0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.211101 Dec 03 03:38:41.856453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 296/584] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:41 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:42.300519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:42.301302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:42.310168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:42.310954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:42.311971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:42.312639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:42.372278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. Dec 03 03:38:42.373245 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:38:42.374961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0dc6a52e-e50f-412a-9f6a-07b4c9fb8129 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 404 len: 111 microversion: 2.1 time: 0.085337 Dec 03 03:38:42.376052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 289/585] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:42 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:38:42.391969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-015daa80-8d8e-483d-88d8-a3a59c6fe9bc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '.version_select at 0x7fe91ab89620>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:42.428023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-015daa80-8d8e-483d-88d8-a3a59c6fe9bc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-117980616" status: 202 len: 0 microversion: 2.1 time: 0.046814 Dec 03 03:38:42.428921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 297/586] 10.222.0.66 () {58 vars in 1208 bytes} [Thu Dec 3 03:38:42 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-117980616 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:38:42.876133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:42.881220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:42.890814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:42.891988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:42.893654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:42.894384 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:43.065640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6013b22a-859a-4ebf-9d76-9bc6e7e895b6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.201921 Dec 03 03:38:43.070483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 290/587] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:42 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:44.084493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:44.085722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:44.094758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:44.095371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:44.096299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:44.096869 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:44.226899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6d3600b5-6a91-4402-9703-c1ce02bce492 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.152049 Dec 03 03:38:44.227980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 298/588] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:44 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:44.697295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: .version_select at 0x7fe91ab89510>, body: {"keypair": {"name": "tempest-keypair-396838792"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:44.726894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:44.731072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:45.182665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:45.187007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:45.201088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2249ed74-4d8e-4475-9694-099c25ac92e9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.514806 Dec 03 03:38:45.201937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 291/589] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Dec 3 03:38:44 2020] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:45.245574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:45.247044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:45.256498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:45.257006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:45.258039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:45.258559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:45.393240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a437bebb-d45d-4ddf-9dae-784f3f28dac6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 14 microversion: 2.20 time: 0.157801 Dec 03 03:38:45.394002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 299/590] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:45 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:46.412283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:46.413453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:46.422283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:46.422807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:46.423656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:46.424146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:46.567452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8446f565-5ea5-4a50-a089-f9bab1a72a4a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 7120 microversion: 2.20 time: 0.165599 Dec 03 03:38:46.568153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 292/591] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:46 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 7120 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:38:46.777577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-df7dc90d-3ef9-48c2-8f21-01ba4802b4cd tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe916a019d8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:46.890512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-df7dc90d-3ef9-48c2-8f21-01ba4802b4cd tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/1782e612-4588-4279-aae9-7668676fc047" status: 200 len: 350 microversion: 2.1 time: 0.117020 Dec 03 03:38:46.891441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 300/592] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:38:46 2020] GET /compute/v2.1/os-volumes/1782e612-4588-4279-aae9-7668676fc047 => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:47.547756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1248303511", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cb459e0-39d6-47ca-bdde-353dad2c0705"}], "security_groups": [{"name": "tempest-securitygroup--912325374"}], "key_name": "tempest-keypair-396838792", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:47.585765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:47.587355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:47.596892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:47.597345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:47.599250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:47.599756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:47.696818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] validate_networks() for [('7cb459e0-39d6-47ca-bdde-353dad2c0705', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:38:47.740202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5fff7563-fd1f-49d6-a0fa-26cf1ce4cb90 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 15025 microversion: 2.20 time: 0.164597 Dec 03 03:38:47.744106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 301/593] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:47 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 15025 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:47.997710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:38:47.997914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:38:47 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.66) !!! Dec 03 03:38:48.422800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:38:48.423276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:38:48.424260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:38:48.424385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:38:48.424786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:38:48.434643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:48.435154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:48.436034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:48.436531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:48.456440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for project 3acd0b3a676a415b9224f87276c4423d. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:38:48.463250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Getting quotas for user 28d7218059084f8b99e430b20b84bb51 and project 3acd0b3a676a415b9224f87276c4423d. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:38:48.477987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:38:48.480785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:38:48.501703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0c265d03-8e07-4fe4-a451-a5e172304177 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe916a5a2f0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:48.537581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ee9ede6-714b-441a-bbfe-4c798e11b495 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.999892 Dec 03 03:38:48.538322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 293/594] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:38:47 2020] POST /compute/v2.1/servers => generated 401 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:38:48.555524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f88cee73-81b7-401e-a245-4efc5dddc051 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:48.556210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f88cee73-81b7-401e-a245-4efc5dddc051 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:48.608246 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0c265d03-8e07-4fe4-a451-a5e172304177 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/95f9430a-7f1e-4517-a9c9-b017a4ea8fdb" status: 200 len: 350 microversion: 2.1 time: 0.116448 Dec 03 03:38:48.608987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 302/595] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:38:48 2020] GET /compute/v2.1/os-volumes/95f9430a-7f1e-4517-a9c9-b017a4ea8fdb => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:38:48.651531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f88cee73-81b7-401e-a245-4efc5dddc051 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:48.661093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f88cee73-81b7-401e-a245-4efc5dddc051 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1237 microversion: 2.1 time: 0.115974 Dec 03 03:38:48.661762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 294/596] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:48 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:38:48.758531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:48.760007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:48.770386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:48.774217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:48.774217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:48.774217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:48.913376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1503cf8b-1a39-4fbb-b64e-47d80c10bc9f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 18608 microversion: 2.20 time: 0.164833 Dec 03 03:38:48.914993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 303/597] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:48 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 18608 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:49.685054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:49.685708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:49.694194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:49.694730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:49.695566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:49.696065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:49.849757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:49.858998 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5e4775bb-f651-4bb3-813b-52d79460f2ce tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1297 microversion: 2.1 time: 0.183920 Dec 03 03:38:49.859658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 295/598] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:49 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1297 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:49.932772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:49.933920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:49.942834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:49.943274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:49.944118 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:49.944607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:50.125522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a7e1c185-409b-4e4f-8a1e-6ba6973c8a56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 20074 microversion: 2.20 time: 0.203457 Dec 03 03:38:50.126199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 304/599] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:49 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 20074 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:50.227913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0de39664-b73f-4875-8e9d-fab9db43e17e tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9156a4620>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.333566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0de39664-b73f-4875-8e9d-fab9db43e17e tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/27f98893-86c7-4329-8537-83d968c94abc" status: 200 len: 351 microversion: 2.1 time: 0.115507 Dec 03 03:38:50.334199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 296/600] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes/27f98893-86c7-4329-8537-83d968c94abc => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:50.352824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-502b523f-1f2c-4779-99ff-a2017b1f5f58 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe917448a60>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.448124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-502b523f-1f2c-4779-99ff-a2017b1f5f58 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.105731 Dec 03 03:38:50.448752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 305/601] 10.222.0.66 () {58 vars in 1124 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:50.467619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5cc0a393-d595-4d50-a1b7-10cb05b8e94d tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9156a4510>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.567920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5cc0a393-d595-4d50-a1b7-10cb05b8e94d tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110163 Dec 03 03:38:50.568555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 297/602] 10.222.0.66 () {58 vars in 1139 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:50.587208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-32cb865d-b8cb-49ed-a248-99b25d9deb11 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9157be598>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.683601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-32cb865d-b8cb-49ed-a248-99b25d9deb11 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106519 Dec 03 03:38:50.684268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 306/603] 10.222.0.66 () {58 vars in 1124 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:50.702606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b2bf9c34-579a-4da4-a7b6-96667076825b tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9154580d0>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.797714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b2bf9c34-579a-4da4-a7b6-96667076825b tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105211 Dec 03 03:38:50.798462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 298/604] 10.222.0.66 () {58 vars in 1157 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:50.823078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-32850a81-4583-4724-809e-0cfff9e89eb9 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe916a6c7b8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.883955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:50.884633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:50.893761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:50.894316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:50.895861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:50.895861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:50.919909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-32850a81-4583-4724-809e-0cfff9e89eb9 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106181 Dec 03 03:38:50.920525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 307/605] 10.222.0.66 () {58 vars in 1160 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:50.941169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-abc94e2f-8635-4316-916c-25762e005644 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9161576a8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:51.039443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-abc94e2f-8635-4316-916c-25762e005644 tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109674 Dec 03 03:38:51.040371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 308/606] 10.222.0.66 () {58 vars in 1145 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:51.058218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c21c2fac-5dd2-4a97-a9db-c726c22bb2be tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe91ab892f0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:51.156336 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c21c2fac-5dd2-4a97-a9db-c726c22bb2be tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.107491 Dec 03 03:38:51.156966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 309/607] 10.222.0.66 () {58 vars in 1178 bytes} [Thu Dec 3 03:38:51 2020] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:51.404924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:51.406484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:51.416102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:51.416855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:51.417869 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:51.418557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:51.431048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:51.441391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-07dfaf65-7c27-4c9e-a4bb-382502db11b3 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.566955 Dec 03 03:38:51.442102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 299/608] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:50 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:51.452115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-51b709a3-5c0d-4c50-b8d4-52ea09ca7c3e tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] Calling method '.version_select at 0x7fe9156a4c80>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:51.551575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-51b709a3-5c0d-4c50-b8d4-52ea09ca7c3e tempest-VolumesTestJSON-1867396172 tempest-VolumesTestJSON-1867396172] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107315 Dec 03 03:38:51.552330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 300/609] 10.222.0.66 () {58 vars in 1145 bytes} [Thu Dec 3 03:38:51 2020] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:51.574157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-50d97493-8c66-4d85-aed6-87ad407a2100 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 23172 microversion: 2.20 time: 0.415794 Dec 03 03:38:51.574884 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 310/610] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:51 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 23172 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:52.465204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:52.466121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:52.475576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:52.476136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:52.477000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:52.477496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:52.562841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d9945d63-42c8-4b29-b129-2714b10caa85 req-df077d1f-dce3-4668-8e00-aa6860c21ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712b9cc1-374c-4057-8718-dc4ca8721c2f", "tag": "63bd1359-9b5c-4d84-95f7-292d15ebcffe"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:52.570192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:52.570192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:52.581225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d9945d63-42c8-4b29-b129-2714b10caa85 req-df077d1f-dce3-4668-8e00-aa6860c21ab0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:52.581781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d9945d63-42c8-4b29-b129-2714b10caa85 req-df077d1f-dce3-4668-8e00-aa6860c21ab0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:52.606570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d9945d63-42c8-4b29-b129-2714b10caa85 req-df077d1f-dce3-4668-8e00-aa6860c21ab0 service nova] Creating event network-changed:63bd1359-9b5c-4d84-95f7-292d15ebcffe for instance 712b9cc1-374c-4057-8718-dc4ca8721c2f on hv-cinder-74915 Dec 03 03:38:52.612124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d9945d63-42c8-4b29-b129-2714b10caa85 req-df077d1f-dce3-4668-8e00-aa6860c21ab0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059190 Dec 03 03:38:52.612950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 311/611] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:52 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:38:52.624912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:52.626072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:52.635920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:52.636695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:52.637563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:52.638056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:52.790898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-004efa47-dc96-497f-adf0-9e0e40917b05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 24694 microversion: 2.20 time: 0.175859 Dec 03 03:38:52.791723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 312/612] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:52 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 24694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:52.946641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:52.955821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e23c64e1-c0fb-4ee6-bbd3-e7dc93e639af tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.500455 Dec 03 03:38:52.956607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 301/613] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:52 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:53.810180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:53.811346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:53.821563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:53.822072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:53.822968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:53.823543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:53.962717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4d56a9a5-963c-4c19-8022-d00087db65b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 26087 microversion: 2.20 time: 0.162690 Dec 03 03:38:53.963704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 313/614] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:53 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 26087 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:53.980716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:53.981394 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:53.991865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:53.992374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:53.993242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:53.993795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:54.318470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:54.327339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5f75ea25-2d44-4efa-9542-81084925bd26 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.357090 Dec 03 03:38:54.327876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 302/615] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:53 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:54.982281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:54.983411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:54.992775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:54.993284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:54.994126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:54.994651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:55.129100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-935ca17b-eced-4b76-a0c2-2ce7f4d877af tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 27188 microversion: 2.20 time: 0.157107 Dec 03 03:38:55.129791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 314/616] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:54 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 27188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:55.443023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:55.443691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:55.451671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:55.452184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:55.453000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:55.453499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:55.674785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:55.684927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d6c61011-d2b7-47f4-b8c0-725f5c583d3d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.343601 Dec 03 03:38:55.685825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 303/617] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:55 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:56.151303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:56.152483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:56.161323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:56.162752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:56.163927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:56.164650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:56.328159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3bde5d45-ce87-4555-9920-65a0fcf3cf20 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 27940 microversion: 2.20 time: 0.189390 Dec 03 03:38:56.329193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 315/618] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:56 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 27940 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:56.709985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:56.710795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:56.718925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:56.719435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:56.720320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:56.720808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:56.959617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:56.968553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a6de1846-4988-4320-b626-57e6038bc5c2 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.268544 Dec 03 03:38:56.969422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 304/619] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:56 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:57.074713 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c39c4a63-ef78-4b6b-b405-be757e43f23d req-c98b5491-8ad1-4163-9f7c-782c2641612f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712b9cc1-374c-4057-8718-dc4ca8721c2f", "name": "network-vif-plugged", "status": "completed", "tag": "63bd1359-9b5c-4d84-95f7-292d15ebcffe"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:57.081717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:38:57.081717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:38:57.091709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c39c4a63-ef78-4b6b-b405-be757e43f23d req-c98b5491-8ad1-4163-9f7c-782c2641612f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:57.092133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c39c4a63-ef78-4b6b-b405-be757e43f23d req-c98b5491-8ad1-4163-9f7c-782c2641612f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:57.110962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c39c4a63-ef78-4b6b-b405-be757e43f23d req-c98b5491-8ad1-4163-9f7c-782c2641612f service nova] Creating event network-vif-plugged:63bd1359-9b5c-4d84-95f7-292d15ebcffe for instance 712b9cc1-374c-4057-8718-dc4ca8721c2f on hv-cinder-74915 Dec 03 03:38:57.116762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c39c4a63-ef78-4b6b-b405-be757e43f23d req-c98b5491-8ad1-4163-9f7c-782c2641612f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053638 Dec 03 03:38:57.117403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 316/620] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:38:57 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:38:57.347064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:57.348212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:57.357401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:57.357907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:57.358937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:57.359431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:57.790425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bed85218-6aa6-41c3-80d6-cea5ba0bb966 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28253 microversion: 2.20 time: 0.453619 Dec 03 03:38:57.791119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 305/621] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:57 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28253 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:57.994515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:57.995415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:58.003761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:58.004304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:58.005686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:58.006179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:58.455099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:58.464488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-79e7e201-ac8b-4009-96c8-57f53ea3ba86 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1362 microversion: 2.1 time: 0.480848 Dec 03 03:38:58.465097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 317/622] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:57 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:58.809309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:58.810487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:58.819512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:58.820025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:58.820876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:58.821365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:58.951076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2bb75631-bba0-4e71-a559-23d659e2ae56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28253 microversion: 2.20 time: 0.152325 Dec 03 03:38:58.952036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 306/623] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:58 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:38:59.489134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:59.490739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:59.499597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.500237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:59.501097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.501586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:59.732824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:38:59.742592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6b270401-3ead-4dcb-9b75-9b3df8a23e91 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1548 microversion: 2.1 time: 0.263261 Dec 03 03:38:59.742904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 318/624] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:38:59 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1548 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:38:59.767392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:38:59.768027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:59.776820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.777324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:59.778146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.778657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:59.939356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-146f209e-13b4-47f0-9bea-498b89053f8c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181760 Dec 03 03:38:59.940057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 307/625] 10.222.0.66 () {58 vars in 1265 bytes} [Thu Dec 3 03:38:59 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:38:59.968993 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:38:59.970128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:38:59.978901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.979411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:38:59.980247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:38:59.980741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:00.119837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d9626a68-1d8f-4090-979c-701f38cb5afc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28544 microversion: 2.20 time: 0.159592 Dec 03 03:39:00.124053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 319/626] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:38:59 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:01.139185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:01.140879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:01.150885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:01.151552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:01.152934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:01.153797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:01.308783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8864c6e1-1a0e-4721-aba8-086b1b80e1bc tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28712 microversion: 2.20 time: 0.180203 Dec 03 03:39:01.312989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 308/627] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:01 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28712 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:01.494705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:01.495847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:01.496912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f4f2202a-26c3-40f8-9309-668fe4ce5b5c req-7763fc01-2538-4ae2-9f9e-4fbcb137dba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712b9cc1-374c-4057-8718-dc4ca8721c2f", "tag": "63bd1359-9b5c-4d84-95f7-292d15ebcffe"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:01.503778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:01.503778 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:01.504426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:01.505742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:01.507192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:01.507677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:01.515474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f4f2202a-26c3-40f8-9309-668fe4ce5b5c req-7763fc01-2538-4ae2-9f9e-4fbcb137dba5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:01.516106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f4f2202a-26c3-40f8-9309-668fe4ce5b5c req-7763fc01-2538-4ae2-9f9e-4fbcb137dba5 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:01.534587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f4f2202a-26c3-40f8-9309-668fe4ce5b5c req-7763fc01-2538-4ae2-9f9e-4fbcb137dba5 service nova] Creating event network-changed:63bd1359-9b5c-4d84-95f7-292d15ebcffe for instance 712b9cc1-374c-4057-8718-dc4ca8721c2f on hv-cinder-74915 Dec 03 03:39:01.540945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f4f2202a-26c3-40f8-9309-668fe4ce5b5c req-7763fc01-2538-4ae2-9f9e-4fbcb137dba5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055116 Dec 03 03:39:01.542137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 309/628] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:01 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:01.647297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7f5bac37-0079-4d22-90e6-4bbdb1ab90b6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.162570 Dec 03 03:39:01.647742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 320/629] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:01 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:02.328858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:02.330931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:02.341756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:02.342550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:02.343577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:02.344330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:02.489979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d7d39e8d-fa37-48ac-ade0-86a971b62a16 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28712 microversion: 2.20 time: 0.171438 Dec 03 03:39:02.494640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 310/630] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:02 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28712 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:02.665529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:02.667044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:02.676245 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:02.677734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:02.678769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:02.679408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:02.825765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0c274a4f-3034-4b29-82b3-4e8b3a35c1b0 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.170646 Dec 03 03:39:02.826846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 321/631] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:02 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:03.508441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:03.509569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:03.518440 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:03.518952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:03.519793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:03.520289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:03.655732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-66d6d159-dc47-4875-84cc-b64eda04a52f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28712 microversion: 2.20 time: 0.156730 Dec 03 03:39:03.656370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 311/632] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:03 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:03.844413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:03.845565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:03.854843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:03.855351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:03.856245 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:03.856733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:03.982808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-eb0f914a-303d-4185-b028-935015cf094c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.147947 Dec 03 03:39:03.983400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 322/633] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:03 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:04.674720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:04.675867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:04.685024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:04.685530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:04.686393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:04.686887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:04.829583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27fa5c2a-4629-43fa-a25d-0a5e57f82868 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 28848 microversion: 2.20 time: 0.164865 Dec 03 03:39:04.830303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 312/634] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:04 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 28848 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:05.001058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:05.002189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:05.011037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:05.011797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:05.012613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:05.013100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:05.149324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-abc35827-bdb1-4b64-b968-3a0e24892608 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.158355 Dec 03 03:39:05.149914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 323/635] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:04 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:05.848269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:05.849643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:05.859422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:05.860018 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:05.861553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:05.861883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:06.019697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-00f16d18-3c68-41cb-a2a3-34d5fd1c3dbb tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 31145 microversion: 2.20 time: 0.181528 Dec 03 03:39:06.020330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 313/636] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:05 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 31145 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:06.166995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:06.168150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:06.176928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:06.177984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:06.178856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:06.179349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:06.316876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-40d35879-2987-42c8-aa1e-6473333229b5 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.159594 Dec 03 03:39:06.317572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 324/637] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:06 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:06.852239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1110683053"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:06.852909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:06.861532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:06.862039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:06.862906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:06.863447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.039574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:07.040730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:07.049533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:07.050334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.051197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:07.051692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.087823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.network.security_group_api [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Removing security group 56bce161-4a34-481a-a18f-9044a48391f5 from port 28667180-06cd-43b5-8695-54a0887da00a Dec 03 03:39:07.196357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-00e7567c-9204-4f68-85bb-bdbf194f2f7b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 33031 microversion: 2.20 time: 0.167260 Dec 03 03:39:07.197048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 325/638] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:07 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 33031 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:07.341188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:07.342717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:07.354471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:07.359818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.361012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:07.361649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.520709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-367e8859-c359-4189-8592-88398afe533e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.194094 Dec 03 03:39:07.522300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 326/639] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:07 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:07.851995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cb99e315-24d8-46bb-aae3-1e1910952299 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action" status: 202 len: 0 microversion: 2.1 time: 1.009677 Dec 03 03:39:07.852564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 314/640] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:06 2020] POST /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/action => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:07.867832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0dc5915e-0533-4085-9c49-8f559c3d786d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '.version_select at 0x7fe9156b6840>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:07.868516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-87f0223c-5ad5-4bfb-a771-7d8bdec338c3 req-94a85e54-9025-46b4-884d-c206cd4f959e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:07.875397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:07.875397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:07.885592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-87f0223c-5ad5-4bfb-a771-7d8bdec338c3 req-94a85e54-9025-46b4-884d-c206cd4f959e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:07.886093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-87f0223c-5ad5-4bfb-a771-7d8bdec338c3 req-94a85e54-9025-46b4-884d-c206cd4f959e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:07.905728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-87f0223c-5ad5-4bfb-a771-7d8bdec338c3 req-94a85e54-9025-46b4-884d-c206cd4f959e service nova] Creating event network-changed:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:39:07.910840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-87f0223c-5ad5-4bfb-a771-7d8bdec338c3 req-94a85e54-9025-46b4-884d-c206cd4f959e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052258 Dec 03 03:39:07.912256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 315/641] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:07 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:08.220241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:08.221464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:08.230584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.231201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.232197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.232766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.377187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c5a0acf5-d5e1-4d65-89cb-47ba0e39fd5c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 33923 microversion: 2.20 time: 0.170696 Dec 03 03:39:08.378181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 316/642] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:08 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 33923 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:08.404987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0dc5915e-0533-4085-9c49-8f559c3d786d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/56bce161-4a34-481a-a18f-9044a48391f5" status: 202 len: 0 microversion: 2.1 time: 0.547150 Dec 03 03:39:08.405674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 327/643] 10.222.0.66 () {58 vars in 1262 bytes} [Thu Dec 3 03:39:07 2020] DELETE /compute/v2.1/os-security-groups/56bce161-4a34-481a-a18f-9044a48391f5 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:08.420903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '.version_select at 0x7fe91ab89a60>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:08.538254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:08.539445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:08.564148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.564664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.565512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.566048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.707651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-846968ba-4821-4c23-993c-98091bffaa99 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.178499 Dec 03 03:39:08.710021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 328/644] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:08 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 03 03:39:08.825633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:08.826650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:08.836319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.837064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.838154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:08.838671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:08.908230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lazy-loading 'flavor' on Instance uuid 7d1cee60-e1d6-4b2c-a218-27203e9065f6 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:39:09.072254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-79a7cd90-cd00-4c80-a5b2-aa8d54c31388 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action" status: 202 len: 0 microversion: 2.1 time: 0.257413 Dec 03 03:39:09.076630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 329/645] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:08 2020] POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:39:09.096338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:09.097297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:09.108363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.109037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:09.110117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.110671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:09.587108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:09.600610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.601120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:09.601971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.602486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:09.671164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Acquired lock "refresh_cache-75622a80-5890-4275-a3ae-92992d9bd724" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:39:09.798030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:09.810479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-65e5ecd5-8fa6-4b54-a5a0-3afabb161753 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.730210 Dec 03 03:39:09.811324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 330/646] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:09 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:09.824089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:09.825974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:09.837784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.838665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:09.840097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:09.840938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:10.014382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cb7a3a06-1c98-4167-8148-fb5f69ecf6ee tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 35354 microversion: 2.20 time: 0.201584 Dec 03 03:39:10.015457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 331/647] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:09 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 35354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:10.026511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:10.027668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:10.037599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:10.038136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:10.039037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:10.039570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:10.181381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-70a1c856-fd84-4c74-b72d-51b44b56010b tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 14 microversion: 2.1 time: 0.164300 Dec 03 03:39:10.184969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 332/648] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:10 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 03 03:39:10.837033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:10.837845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:10.846557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:10.847072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:10.847921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:10.848422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:11.328174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:11.337315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-05d28b6a-b1c7-42b5-90d8-93e717f13a64 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.510294 Dec 03 03:39:11.347963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 333/649] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:10 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:11.347963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:11.349538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:11.357058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:11.357558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:11.358421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:11.358909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:11.505379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-16757931-fb51-42d4-ac10-e083e7e0f82c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 36899 microversion: 2.20 time: 0.165973 Dec 03 03:39:11.506508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 334/650] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:11 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 36899 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:11.517370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:11.518544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:11.527268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:11.527776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:11.528624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:11.529114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:11.685066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-85ee2e5e-b5c9-4b6a-a08a-6bdeef47b733 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 8267 microversion: 2.1 time: 0.177243 Dec 03 03:39:11.686092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 335/651] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:11 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 8267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:11.823724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:39:12.038426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-848cf426-e35f-4ec4-957b-855b87df9321 req-06d938b5-9207-4256-afe1-8932cdff80ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:12.045481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:12.045481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:12.056569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-848cf426-e35f-4ec4-957b-855b87df9321 req-06d938b5-9207-4256-afe1-8932cdff80ed service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:12.057086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-848cf426-e35f-4ec4-957b-855b87df9321 req-06d938b5-9207-4256-afe1-8932cdff80ed service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:12.076054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-848cf426-e35f-4ec4-957b-855b87df9321 req-06d938b5-9207-4256-afe1-8932cdff80ed service nova] Creating event network-changed:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:39:12.082028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-848cf426-e35f-4ec4-957b-855b87df9321 req-06d938b5-9207-4256-afe1-8932cdff80ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252427 Dec 03 03:39:12.082896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 336/652] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:11 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:39:12.362408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:12.363225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:12.372040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:12.372649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:12.373576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:12.374145 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.146744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:13.157233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4d13e838-5be0-456b-8f12-63adbce15896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.805023 Dec 03 03:39:13.157938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 337/653] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:12 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:13.169652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:13.170817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:13.192822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.193640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.195388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.201365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.362587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6e22d8ee-8e58-4b72-9920-972aa8ae3799 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 38262 microversion: 2.20 time: 0.202743 Dec 03 03:39:13.366220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 338/654] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:13 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 38262 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:13.380122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:13.383509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:13.391641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Updating instance_info_cache with network_info: [{"id": "28667180-06cd-43b5-8695-54a0887da00a", "address": "fa:16:3e:3b:4a:12", "network": {"id": "330d9e4d-fc33-4815-90f4-d12bca58f5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587950612-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0840879b0906445784a83ceb05926684", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap28667180-06", "ovs_interfaceid": "28667180-06cd-43b5-8695-54a0887da00a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:39:13.392434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.392947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.393802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.394366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.407539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Releasing lock "refresh_cache-75622a80-5890-4275-a3ae-92992d9bd724" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:39:13.408827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0e63d56d-37ce-458d-b81c-ac10f8b09c7f tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/bf51edf0-24c8-44e1-9498-0e423265b14b" status: 202 len: 0 microversion: 2.1 time: 4.998206 Dec 03 03:39:13.409652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 317/655] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:39:08 2020] DELETE /compute/v2.1/os-floating-ips/bf51edf0-24c8-44e1-9498-0e423265b14b => generated 0 bytes in 5000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:13.423909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:13.424380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:13.433156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.433664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.434592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:13.435090 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:13.570354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9b8b3222-20af-4534-b4f1-97bddeaa7a46 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 18449 microversion: 2.1 time: 0.203920 Dec 03 03:39:13.571827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 339/656] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:13 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 18449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:13.783559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e93d0cf1-541f-42f6-9f70-7c8a0af3926b tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments/2d1c3cf7-8bd2-4619-8d62-1f26121c5b32" status: 202 len: 0 microversion: 2.1 time: 0.368650 Dec 03 03:39:13.784204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 318/657] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:39:13 2020] DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments/2d1c3cf7-8bd2-4619-8d62-1f26121c5b32 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:39:14.183109 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:14.183896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:14.193317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.194058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.194954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.195460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.383334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:14.384818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:14.393410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.394226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.395495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.396562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.426338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:14.435684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f49d1075-5db8-4e83-a43a-6e53d7cff784 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.263143 Dec 03 03:39:14.436498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 340/658] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:14 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:14.531219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c1fc4904-6997-4687-b687-9a934ee68411 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 38262 microversion: 2.20 time: 0.158405 Dec 03 03:39:14.535596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 319/659] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:14 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 38262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:39:14.588807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:14.589842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:14.597672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.598292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.599292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:14.599787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:14.739456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cebb5502-5d14-4ee8-882c-618d90c112ef tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 19342 microversion: 2.1 time: 0.160470 Dec 03 03:39:14.741334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 341/660] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:14 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 19342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:15.115898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:15.116570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:15.125181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.125700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.126768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.127257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.308381 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] HTTP exception thrown: Instance 75622a80-5890-4275-a3ae-92992d9bd724 is not attached to volume 2d1c3cf7-8bd2-4619-8d62-1f26121c5b32 Dec 03 03:39:15.309051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Returning 404 to user: Instance 75622a80-5890-4275-a3ae-92992d9bd724 is not attached to volume 2d1c3cf7-8bd2-4619-8d62-1f26121c5b32 {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:39:15.309954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2fc5deef-1d8f-4d88-8394-c95de077e4de tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments/2d1c3cf7-8bd2-4619-8d62-1f26121c5b32" status: 404 len: 154 microversion: 2.1 time: 0.205766 Dec 03 03:39:15.310630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 320/661] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:39:15 2020] DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724/os-volume_attachments/2d1c3cf7-8bd2-4619-8d62-1f26121c5b32 => generated 154 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:39:15.462895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:15.463673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:15.472301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.472827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.473674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.475490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.549667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:15.550668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:15.559731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.560235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.561069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.561560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.699003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f2fd7d73-177d-4b33-831d-c8d3ece26e54 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 38262 microversion: 2.20 time: 0.158766 Dec 03 03:39:15.700969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 321/662] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:15 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 38262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:39:15.754854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:15.759316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:15.760476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:15.765056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fd58a7d9-25bd-44d2-a3f6-9a6f32e436e3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.313169 Dec 03 03:39:15.765786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 342/663] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:15 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:15.769451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.770113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.771358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:15.772578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:15.913011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cb617cca-9541-428b-b5ae-652b119b0eea tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 21972 microversion: 2.1 time: 0.162965 Dec 03 03:39:15.914075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 322/664] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:15 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 21972 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:39:16.577316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:16.577821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:16.586920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.587438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.588283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.588779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.666117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:39:16.721331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:16.722576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:16.732074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.732583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.733428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.733920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.796835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f71eb349-4485-45c2-b85c-7ccb3cdee63d tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 204 len: 0 microversion: 2.1 time: 0.229525 Dec 03 03:39:16.797596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 343/665] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:39:16 2020] DELETE /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:39:16.810631 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:16.811588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:16.819720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.820227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.821079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.821574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.947965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cd9e3975-5c82-4891-8291-238cc98b17f9 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 200 len: 38403 microversion: 2.20 time: 0.238961 Dec 03 03:39:16.948770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 323/666] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:16 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 38403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:16.982586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:16.983628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:16.994567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.995379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:16.996402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:16.997050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:17.308730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:17.319046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a81a9415-d290-4f04-8fb3-6d05651d31cb tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.519346 Dec 03 03:39:17.322391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 344/667] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:16 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:17.333703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:17.334897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:17.343862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:17.344365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:17.345205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:17.345960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:17.354703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:17.364853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f54d8a68-766e-4730-b37d-7ac9b7b28099 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1553 microversion: 2.1 time: 0.414606 Dec 03 03:39:17.365824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 324/668] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:16 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:17.376097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:17.377021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:17.386106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:17.387285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:17.388369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:17.389064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:17.458120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c987c699-8d4e-461f-926c-7721e89c0b39 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/ips" status: 200 len: 152 microversion: 2.20 time: 0.090724 Dec 03 03:39:17.459971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 325/669] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Dec 3 03:39:17 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/ips => generated 152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:17.488237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b6117834-3951-4d2d-91d9-728ca59eff5d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 23804 microversion: 2.1 time: 0.163918 Dec 03 03:39:17.489806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 345/670] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:17 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 23804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:18.342075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:18.342770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:18.351764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.352270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.353107 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.353600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.391674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:18.392538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:18.401595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.402200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.403280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.403843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.703449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:18.715016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fbb826db-1785-493c-8c86-53faf06381d3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.382421 Dec 03 03:39:18.716062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 326/671] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:18 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:18.717548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:18.727602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:18.727834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-da6a0022-1519-4388-8c4b-b095501e6afe tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1553 microversion: 2.1 time: 0.347558 Dec 03 03:39:18.728759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 346/672] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:18 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:18.729688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:18.737635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.738081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.738955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:18.739449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:18.922806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64ea9801-25df-4f6c-9d60-a5384edf1be9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 25449 microversion: 2.1 time: 0.205126 Dec 03 03:39:18.927013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 327/673] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:18 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 25449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:19.741625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:19.742763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:19.750641 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:19.751291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:19.752252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:19.752860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:19.757651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:19.758465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:19.767268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:19.767714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:19.768559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:19.769032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:20.703908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:20.718820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0fabbcea-e0be-4fa2-9637-7f740c02bae6 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1553 microversion: 2.1 time: 0.971951 Dec 03 03:39:20.723407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:20.744549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 328/674] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:19 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1553 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:20.750958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-55ca5144-2657-4243-a092-eed84483e1f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 1.017833 Dec 03 03:39:20.752628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 347/675] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:19 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:20.760534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:20.761318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:20.774444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:20.775208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:20.776370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:20.776704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:20.777215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:20.777839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:20.786162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:20.788738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:20.790339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:20.792768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:20.870418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lazy-loading 'flavor' on Instance uuid f0194cfc-db6e-4023-b4cd-aaad443f3847 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:39:21.032244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-61fcea72-dc24-4cae-b0a3-c4397fc21897 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 27625 microversion: 2.1 time: 0.270773 Dec 03 03:39:21.032244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 348/676] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:20 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 27625 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:21.044765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-e7e40b28-b6c5-464d-b182-78841483ef81 req-9f68e3e4-b789-48d4-88dd-22fce7c16a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75622a80-5890-4275-a3ae-92992d9bd724", "name": "network-vif-deleted", "tag": "28667180-06cd-43b5-8695-54a0887da00a"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:21.051805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:21.051805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:21.062302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e7e40b28-b6c5-464d-b182-78841483ef81 req-9f68e3e4-b789-48d4-88dd-22fce7c16a10 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.062816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e7e40b28-b6c5-464d-b182-78841483ef81 req-9f68e3e4-b789-48d4-88dd-22fce7c16a10 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.082396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-e7e40b28-b6c5-464d-b182-78841483ef81 req-9f68e3e4-b789-48d4-88dd-22fce7c16a10 service nova] Creating event network-vif-deleted:28667180-06cd-43b5-8695-54a0887da00a for instance 75622a80-5890-4275-a3ae-92992d9bd724 on hv-cinder-74915 Dec 03 03:39:21.090999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-e7e40b28-b6c5-464d-b182-78841483ef81 req-9f68e3e4-b789-48d4-88dd-22fce7c16a10 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056179 Dec 03 03:39:21.091986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 349/677] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:21 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:21.290885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d91109dc-81a0-494c-8fa9-9f63fb757536 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 202 len: 0 microversion: 2.20 time: 0.544886 Dec 03 03:39:21.291582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 329/678] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:39:20 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:39:21.306148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:21.306961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:21.315114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.315622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.316457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.316946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.534627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:21.549237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:21.556367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:21.557550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3d9c1fa-87e8-431e-bf22-683b86fd2e5e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.261196 Dec 03 03:39:21.558130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 350/679] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:21 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:21.743286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:21.744048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:21.752944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.753494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.754265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.754757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.776809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:21.777518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:21.785645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.786149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.787214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.787709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.836156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:21.836658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:21.837161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lazy-loading 'fault' on Instance uuid 75622a80-5890-4275-a3ae-92992d9bd724 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:39:21.972217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:21.982168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-99a41bf3-8255-4e90-b7d4-abba5fd43443 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1347 microversion: 2.1 time: 0.249103 Dec 03 03:39:21.982828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 330/680] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:21 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1347 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:22.047690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:22.048843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:22.051592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:22.057769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:22.058304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:22.059159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:22.059658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:22.061390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-51a2e47d-d058-4b92-83b3-e5169bcc09f9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.294331 Dec 03 03:39:22.062186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 351/681] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:21 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:22.584010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:22.584718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:22.592567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:22.593079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:22.593907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:22.594437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:22.816192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:22.840601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:22.847894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:22.849867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-833f4c4f-0b68-4318-9514-8b6d683f1b4d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.275010 Dec 03 03:39:22.850502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 352/682] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:22 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:23.006740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:23.007405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:23.015656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.016160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.017002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.017490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.102455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.102893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.103412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lazy-loading 'fault' on Instance uuid 75622a80-5890-4275-a3ae-92992d9bd724 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:39:23.171322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:23.180781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bb38ce59-5dee-43d6-be5f-03a496ee8447 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1347 microversion: 2.1 time: 0.183426 Dec 03 03:39:23.181559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 353/683] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:22 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1347 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:23.200786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:23.201463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:23.209760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.210340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.211186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.211678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.430537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:23.439462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4eb791fd-e5d1-4960-b695-db573d7ee48e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.256036 Dec 03 03:39:23.440059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 354/684] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:23 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:23.874568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:23.875226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:23.883039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.883534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:23.884363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:23.884872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.061391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a2cf8097-c09c-4b16-bed8-a83ce5aeb432 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 27801 microversion: 2.1 time: 2.023160 Dec 03 03:39:24.065509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 331/685] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:22 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 27801 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:39:24.108297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:24.122812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:24.129404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:24.131351 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-350e5190-1a49-464e-ae16-b5d2face7dda tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.266067 Dec 03 03:39:24.132113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 355/686] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:23 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:24.205578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:24.206375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:24.216128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:24.216745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.217596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:24.217945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.298867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:24.299387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.299900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lazy-loading 'fault' on Instance uuid 75622a80-5890-4275-a3ae-92992d9bd724 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:39:24.369054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522363549604fe1b2be8b5ac5a0c002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0840879b0906445784a83ceb05926684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:24.377234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7b2d174e-a955-4cff-9ca5-33b16428641e tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 200 len: 1347 microversion: 2.1 time: 0.181472 Dec 03 03:39:24.377827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 332/687] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:24 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 1347 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:24.464187 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:24.464860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:24.472730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:24.473274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.474571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:24.475076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:24.698746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:24.707746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-72cd9a7f-326f-491d-9709-e5181da6ad6c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.253831 Dec 03 03:39:24.708911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 356/688] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:24 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:25.078570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:25.079616 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:25.088059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.088550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.089382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.089877 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.156101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:25.156900 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:25.165428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.166009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.167011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.167506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.238528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2e359e1d-63ad-47df-8fb6-338b07e86933 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28171 microversion: 2.1 time: 0.167550 Dec 03 03:39:25.240907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 333/689] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:25 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28171 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:25.390367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:25.403032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:25.403817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] [instance: 75622a80-5890-4275-a3ae-92992d9bd724] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:25.406059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:25.412844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.413016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:25.413362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.414153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3c261d59-f827-47c7-b715-be92ba176a1f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.267261 Dec 03 03:39:25.414302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.414712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.414860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 357/690] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:25 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:25.469677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] HTTP exception thrown: Instance 75622a80-5890-4275-a3ae-92992d9bd724 could not be found. Dec 03 03:39:25.470398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Returning 404 to user: Instance 75622a80-5890-4275-a3ae-92992d9bd724 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:39:25.471309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1ebd87cc-bd88-49ad-ab03-71a6014a3ca3 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724" status: 404 len: 111 microversion: 2.1 time: 0.078861 Dec 03 03:39:25.471930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 334/691] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:25 2020] GET /compute/v2.1/servers/75622a80-5890-4275-a3ae-92992d9bd724 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:39:25.486807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-341bdb8f-d131-46c2-9930-5f7b207e50f2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] Calling method '.version_select at 0x7fe916a016a8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:25.509066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-341bdb8f-d131-46c2-9930-5f7b207e50f2 tempest-TestMinimumBasicScenario-974781014 tempest-TestMinimumBasicScenario-974781014] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1903056999" status: 202 len: 0 microversion: 2.1 time: 0.031554 Dec 03 03:39:25.509694 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 358/692] 10.222.0.66 () {58 vars in 1262 bytes} [Thu Dec 3 03:39:25 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1903056999 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:25.733529 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:25.734572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:25.744671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.745176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.746011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:25.746557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:25.986980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:25.996525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4fb2130b-519f-40fd-81a8-28f9d0328f36 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.274487 Dec 03 03:39:25.997117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 335/693] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:25 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:26.256743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:26.257902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:26.267001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:26.267502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:26.268344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:26.268836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:26.438678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:26.439274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:26.448418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:26.449067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:26.449997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:26.450636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:26.892891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:26.909179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:26.917165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:26.918428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-027d5dad-f42d-4117-bd34-347ce8e2449f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.489108 Dec 03 03:39:26.919026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 336/694] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:26 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:27.022003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:27.022308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:27.030282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:27.030790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:27.031631 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:27.032131 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:27.344083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:27.353722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-aa0bc24a-8682-47d5-b814-ad601ce7c4b8 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.342323 Dec 03 03:39:27.354320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 337/695] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:27 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:27.946572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:27.947239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:27.955238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:27.955745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:27.956633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:27.957122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:28.275492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:28.290089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:28.296687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:28.297901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bc6c2626-da67-4027-ae08-fe8297645db1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.361551 Dec 03 03:39:28.298517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 338/696] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:27 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:28.376834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:28.377568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:28.386693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:28.387075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:28.387917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:28.388412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:28.857671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:28.867838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f970bc8b-c7ab-4456-b0f2-665b42dcc6b6 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1574 microversion: 2.1 time: 0.500257 Dec 03 03:39:28.868670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 339/697] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:28 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1574 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:28.893354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1f9de12e-f77a-4201-80f0-15ebe6425605 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28171 microversion: 2.1 time: 2.644882 Dec 03 03:39:28.898911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 359/698] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:26 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28171 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:29.338930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:29.341283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:29.372640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.373971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.375292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.376290 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.436116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-5b47a8c0-d764-4819-9894-ca76fcb7c4aa req-3a1278f8-6739-4120-a539-348a1a5cd824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:29.444685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:29.444685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:29.454687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5b47a8c0-d764-4819-9894-ca76fcb7c4aa req-3a1278f8-6739-4120-a539-348a1a5cd824 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.455195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5b47a8c0-d764-4819-9894-ca76fcb7c4aa req-3a1278f8-6739-4120-a539-348a1a5cd824 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.480153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-5b47a8c0-d764-4819-9894-ca76fcb7c4aa req-3a1278f8-6739-4120-a539-348a1a5cd824 service nova] Creating event network-vif-unplugged:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:39:29.486783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-5b47a8c0-d764-4819-9894-ca76fcb7c4aa req-3a1278f8-6739-4120-a539-348a1a5cd824 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.251152 Dec 03 03:39:29.487647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 340/699] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:29 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:29.698101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:29.714533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:29.730282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:29.731542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b23aeb30-7332-46c7-b764-8ebd717821ff tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.417291 Dec 03 03:39:29.732664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 360/700] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:29 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:29.892503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:29.893669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:29.913158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:29.916198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.917752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.918543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:29.918797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.919466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.928872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.929550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:29.930836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:29.931475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.114026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f81beb65-7ce1-4b5c-bd41-a35df6fe021d tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28462 microversion: 2.1 time: 0.210623 Dec 03 03:39:30.118556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 361/701] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:29 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28462 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:30.380051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:30.390387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e3fcdc4d-6625-4cca-bee8-f0feb5ebc66e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1575 microversion: 2.1 time: 0.507802 Dec 03 03:39:30.391368 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 341/702] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:29 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1575 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:30.416924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:30.417836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:30.427089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.427817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.428438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.428933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.591498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-237f0c1e-f54b-42c1-9138-4b817edb603c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action" status: 202 len: 0 microversion: 2.1 time: 0.186493 Dec 03 03:39:30.592201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 362/703] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:30 2020] POST /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:39:30.606733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:30.607596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:30.617065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.617750 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.619151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.619656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.763278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:30.766008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:30.783629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.784310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:30.785374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:30.786083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:31.014511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:31.024204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a900a76e-4d46-45c2-afff-b81200c62b0e tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1523 microversion: 2.1 time: 0.427452 Dec 03 03:39:31.025029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 342/704] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:30 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:31.135243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:31.137043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:31.148102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:31.149148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:31.150397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:31.151452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:31.167895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:31.209039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:31.215689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:31.216924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-92a70179-f520-4596-bbd1-907de189ca29 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.467843 Dec 03 03:39:31.217509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 363/705] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:30 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:31.314981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-04b69b64-44c6-4ff1-b7fe-253a4b48abb7 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28630 microversion: 2.1 time: 0.191600 Dec 03 03:39:31.315920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 343/706] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:31 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28630 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:39:32.048746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:32.050210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:32.059973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.060726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.061817 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.062572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.243274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:32.247814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:32.268734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.269653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.271336 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.274773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.381328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:32.394941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3046fa6-8700-40d9-a30d-15d30c93cdf2 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1525 microversion: 2.1 time: 0.355462 Dec 03 03:39:32.396505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 364/707] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:32 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1525 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:32.415965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:32.417388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:32.425656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.426507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.428318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:32.428970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:32.765586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:32.781110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:32.787623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:32.788840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a0a44243-86f9-475d-8a5b-c873fe7c9816 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.556990 Dec 03 03:39:32.789431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 344/708] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:32 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:33.420055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:33.420729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:33.429772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:33.430313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:33.431171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:33.431670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:33.654505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:33.664448 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a9cfb6d1-1768-4daa-9861-f65132f7bd25 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1525 microversion: 2.1 time: 0.254478 Dec 03 03:39:33.665036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 345/709] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:33 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1525 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:33.814122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:33.814824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:33.823133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:33.823647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:33.824476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:33.824975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:34.053494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:34.068888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:34.075612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:34.076727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0e43ea5a-a68c-4946-8420-2d5618475f41 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.271827 Dec 03 03:39:34.077515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 346/710] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:33 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:34.688047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:34.688712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:34.696732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:34.697134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:34.698119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:34.698748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:34.934581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:34.938062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2b7699d8-fe27-4f42-9567-db4e066b7215 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28630 microversion: 2.1 time: 2.539561 Dec 03 03:39:34.938788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 365/711] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:32 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28630 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:34.946150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4202d066-4cb3-4334-8cbb-36b85d94c744 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1525 microversion: 2.1 time: 0.266890 Dec 03 03:39:34.947026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 347/712] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:34 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1525 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:35.102805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:35.103579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:35.112331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.112837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:35.113687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.114842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:35.340401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:35.354846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:35.361265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:35.362477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0281ed63-81f9-439b-b5e2-ee07abc248b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.270159 Dec 03 03:39:35.363061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 366/713] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:35 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:35.956744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:35.957714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:35.966300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.966793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:35.967633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.968124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:35.970402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:35.971117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:35.982027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.982027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:35.982027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:35.982027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:36.097185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-094d573e-0c38-418a-9789-5ec77b2f2bfa tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28630 microversion: 2.1 time: 0.149374 Dec 03 03:39:36.101838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 348/714] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:35 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28630 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:36.342473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:36.357434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8d2ef073-01ce-44fc-bd69-b72f3eea1c0c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1525 microversion: 2.1 time: 0.392253 Dec 03 03:39:36.357434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 367/715] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:35 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1525 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:36.390878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:36.391825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:36.402412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:36.403174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:36.404142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:36.404752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:36.855144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:36.870201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:36.876738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:36.877947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de4a2263-e691-4d55-b1ee-91c898574b1e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.499127 Dec 03 03:39:36.878761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 349/716] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:36 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:37.114676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:37.115927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:37.123986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.124492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:37.125339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.125830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:37.251396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-59230820-c669-4c83-a1e7-584cc1bab7c1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28630 microversion: 2.1 time: 0.145659 Dec 03 03:39:37.252096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 368/717] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:37 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28630 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:37.376465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:37.377069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:37.386066 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.386847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:37.387698 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.388192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:37.613833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:37.624605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-45951e0d-c6ad-4133-91c8-8ff675ef7b10 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.257187 Dec 03 03:39:37.625209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 350/718] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:37 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:37.903898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:37.904677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:37.913488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.914000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:37.914944 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:37.915347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:38.139331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:38.153576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:38.160004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:38.161727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bb0c6d24-50da-4dbf-a37e-557dc85d0622 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.267726 Dec 03 03:39:38.162327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 369/719] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:37 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:38.270296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:38.271474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:38.279352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:38.279865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:38.280700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:38.281197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:38.650089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:38.650794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:38.658784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:38.659297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:38.660134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:38.660629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:38.879269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:38.888858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b4b40db6-d74d-43e2-86a3-3421c9795a04 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.248834 Dec 03 03:39:38.889446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 370/720] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:38 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:39.186622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:39.187287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:39.195413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:39.195925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:39.196768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:39.197256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:39.421580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:39.436161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:39.442741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:39.443936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64992378-b779-4454-addd-86290bc0526d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.266743 Dec 03 03:39:39.444520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 371/721] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:39 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:39.913386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:39.914047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:39.921871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:39.922442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:39.923271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:39.923762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:40.151982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:40.161115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ce961f1d-0350-49b0-bbec-9ef025eb0144 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.257136 Dec 03 03:39:40.161796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 372/722] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:39 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:40.468692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:40.469256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:40.477706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:40.478206 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:40.479102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:40.479594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:40.700239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:40.714734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:40.721302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:40.722471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3df66227-2d0b-4ec1-823b-d0365f0ef756 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.263077 Dec 03 03:39:40.723053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 373/723] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:40 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:40.947257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2ac95d02-8e01-4567-9aa9-d315d7c7aaf6 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 28630 microversion: 2.1 time: 2.686230 Dec 03 03:39:40.947969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 351/724] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:38 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 28630 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:41.185499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:41.186173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:41.194954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.195462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.196310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.196809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.422403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:41.431475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3fc236cd-fe45-4e4a-ad40-c63779378da9 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.256086 Dec 03 03:39:41.432069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 374/725] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:41 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:41.748565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:41.749257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:41.758669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.759186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.760020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.760518 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.964811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:41.965860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:41.974145 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.974757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.975593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:41.976077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:41.985151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:42.000480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:42.007303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:42.008512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b740f61d-e375-40b6-90a9-83362fc22a51 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.270027 Dec 03 03:39:42.009105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 352/726] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:41 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:42.129782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-53aa6f8d-87c6-41c2-898b-1e99c53bb06f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 30102 microversion: 2.1 time: 0.174049 Dec 03 03:39:42.130614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 375/727] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:41 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 30102 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:42.454177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:42.454885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:42.463258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:42.463755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:42.464577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:42.465061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:42.684174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:42.693464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-103e492f-d1a7-4311-970b-b1284c78c6fd tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.248234 Dec 03 03:39:42.694191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 353/728] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:42 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:43.036134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:43.038101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:43.053407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.053926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.054858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.055362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.148746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:43.149937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:43.158687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.159276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.160114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.160598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.283511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:43.298064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:43.304704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:43.305879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0880b439-3f67-4a3d-8d96-d92ea94c61e0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.281154 Dec 03 03:39:43.306497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 376/729] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:43 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:43.325759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bc5e0f91-8467-4f29-b557-fa03e8194741 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 31707 microversion: 2.1 time: 0.187249 Dec 03 03:39:43.326582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 354/730] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:43 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 31707 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:43.717009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:43.717667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:43.726164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.726720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.727564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:43.728064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:43.954719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:43.963576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4c4fe154-c68a-48e6-a212-f268796ad126 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.255862 Dec 03 03:39:43.964160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 377/731] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:43 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:44.332093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:44.332945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:44.341648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.342161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:44.343025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.343453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:44.343593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:44.344556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:44.354344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.354863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:44.355717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.356209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:44.572542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:44.587556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:44.594047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:44.595268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-33a726b3-7a10-4b69-bc2d-46f7bd4096b8 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.273088 Dec 03 03:39:44.595856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 355/732] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:44 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:44.986692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:44.987358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:44.995873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.996380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:44.997210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:44.997699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:45.226905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:45.235826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b77e7c86-f497-4a50-848c-2c9f168fd811 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.258120 Dec 03 03:39:45.236415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 356/733] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:44 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:45.620405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:45.621076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:45.630055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:45.630692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:45.631373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:45.631858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:45.850270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:45.864858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:45.871558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:45.872715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-23549493-92d6-4f45-8b43-db5715f0b9f7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.261604 Dec 03 03:39:45.873296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 357/734] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:45 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:46.259426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:46.260100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:46.268261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:46.268770 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:46.269609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:46.270102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:46.493406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:46.502402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ec43d1a6-3118-45d1-a7a7-498755a9bfb3 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.252872 Dec 03 03:39:46.502999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 358/735] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:46 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:39:46.897929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:46.898662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:46.906617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:46.907133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:46.907974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:46.908468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:47.015569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-77a66772-beee-4d17-8e09-dfa6e278b341 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 34805 microversion: 2.1 time: 2.681877 Dec 03 03:39:47.016514 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 378/736] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:44 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 34805 bytes in 2684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 03 03:39:47.151441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:47.166493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:47.173147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:47.174267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3e64a0a5-c851-4ba9-836f-db13c51a2ebd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.286180 Dec 03 03:39:47.174847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 359/737] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:46 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:47.528214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:47.528909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:47.538858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:47.539375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:47.540227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:47.540725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:47.765413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:47.775377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c7b6fc6c-1a50-442f-8f2e-e53c9b696bae tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.258162 Dec 03 03:39:47.775970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 379/738] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:47 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:48.039824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:48.039824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:48.049411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.049922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.050799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.052170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.198769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-aa58f8d3-daf2-42ed-8434-7a8003340be1 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 35572 microversion: 2.1 time: 0.173812 Dec 03 03:39:48.200086 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 360/739] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:48 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 35572 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:48.205147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:48.206582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:48.215934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.216757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.217838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.218585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.453699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:48.473373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:48.477449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:48.478724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a04e28da-4b88-407f-96e0-025dbdf31f05 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1744 microversion: 2.20 time: 0.289160 Dec 03 03:39:48.479298 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 380/740] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:48 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:48.617748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-73e4db9f-9d8c-41fe-bde8-57e4d3a2be2d req-d94fd974-5bae-4f83-96d8-e27556db4990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "name": "network-vif-plugged", "status": "completed", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:48.624364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:39:48.624364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:39:48.635001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-73e4db9f-9d8c-41fe-bde8-57e4d3a2be2d req-d94fd974-5bae-4f83-96d8-e27556db4990 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.635501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-73e4db9f-9d8c-41fe-bde8-57e4d3a2be2d req-d94fd974-5bae-4f83-96d8-e27556db4990 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.653805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-73e4db9f-9d8c-41fe-bde8-57e4d3a2be2d req-d94fd974-5bae-4f83-96d8-e27556db4990 service nova] Creating event network-vif-plugged:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:39:48.659224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-73e4db9f-9d8c-41fe-bde8-57e4d3a2be2d req-d94fd974-5bae-4f83-96d8-e27556db4990 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051398 Dec 03 03:39:48.659875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 361/741] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:39:48 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:48.798825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:48.799643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:48.811923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.812425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:48.813261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:48.813907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:49.093134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:49.106422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3bd756b7-ec2f-4355-898c-7a21a37bdb33 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.316803 Dec 03 03:39:49.107349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 381/742] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:48 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:49.217870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:49.219093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:49.228352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:49.228880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:49.229730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:49.230226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:49.503736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:49.504927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:49.514224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:49.514785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:49.515697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:49.516184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:49.616055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-86269fe6-dd9b-4576-85ee-f01f4fc2e561 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 36406 microversion: 2.1 time: 0.408205 Dec 03 03:39:49.617707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 362/743] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:49 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 36406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:49.742413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:49.758266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:49.765210 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:49.766471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8b1298a7-96b3-4140-beae-32fa0514e299 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1744 microversion: 2.20 time: 0.272133 Dec 03 03:39:49.767253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 382/744] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:49 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1744 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:39:50.132030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:50.132834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:50.141860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.142396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:50.143235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.143718 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:50.400630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:50.409499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b3f57de7-e350-41a3-8c7e-b75585ad58a1 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1581 microversion: 2.1 time: 0.288036 Dec 03 03:39:50.410097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 363/745] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:50 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1581 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:50.635746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:50.637053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:50.647611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.648125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:50.648985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.649482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:50.794402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f84bfb40-36d7-49fd-8557-92bc66782b08 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 37574 microversion: 2.1 time: 0.168740 Dec 03 03:39:50.796571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:50.797561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:50.799848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 383/746] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:50 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 37574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:50.806960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.807562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:50.808501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:50.809056 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:51.065096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:51.085040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:51.091742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:51.093667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c1545269-07fe-495d-acb6-d23c714cbf56 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.309656 Dec 03 03:39:51.096333 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 364/747] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:50 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:51.433681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:51.439909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:51.453655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:51.454445 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:51.455505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:51.456204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:51.815701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:51.817235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:51.827885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:51.828629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:51.829733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:51.831188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:51.909896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:51.923099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cf09cd29-533f-4f7e-abf1-e64012d30a1d tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1568 microversion: 2.1 time: 0.499125 Dec 03 03:39:51.923881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 384/748] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:39:51 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1568 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:39:52.005628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-00a425f7-f72b-443e-97bb-c99db4fd0912 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 38157 microversion: 2.1 time: 0.200661 Dec 03 03:39:52.006668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 365/749] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:51 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 38157 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:52.122069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:52.123046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:52.131556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:52.132084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:52.132967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:52.133468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:52.378813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:52.394690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:52.401496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:52.402781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0adf438d-79da-4773-aad2-75c63363960c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.291428 Dec 03 03:39:52.403724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 385/750] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:52 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:53.025396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:53.030175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:53.039453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:53.039974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:53.040830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:53.041330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:53.202741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-34f873c6-5421-49f3-a32b-56bbb22da39f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 38157 microversion: 2.1 time: 0.182509 Dec 03 03:39:53.202741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 366/751] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:53 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 38157 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:53.429183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:53.430857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:53.440010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:53.440581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:53.441348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:53.441895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:53.776385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:53.795100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:53.805744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:53.807120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-47f1814b-54d0-49c4-9971-ed980261a3b1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.388620 Dec 03 03:39:53.810667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 386/752] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:53 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:54.216493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:54.221496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:54.230948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.231840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:54.232959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.233771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:54.381862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b98c59a3-72fd-46dd-be69-26074cbbffbc tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action" status: 200 len: 38288 microversion: 2.1 time: 0.175026 Dec 03 03:39:54.383050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 367/753] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:39:54 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/action => generated 38288 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:39:54.409780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:54.414733 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:54.424994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.425728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:54.427747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.428465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:54.524251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-69c5ca62-ae20-4449-bb53-1401e89469ec tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/ips" status: 200 len: 145 microversion: 2.1 time: 0.133818 Dec 03 03:39:54.525122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 387/754] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:39:54 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/ips => generated 145 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:54.834293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:54.839039 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:54.851513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.852425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:54.853482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:54.854171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:55.190691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:55.214573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:55.222829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:55.225414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e85d9ae6-fbb9-45d6-a40c-49382980e770 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.402198 Dec 03 03:39:55.227051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 368/755] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:54 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:56.257868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:56.259897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:56.280812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:56.288519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:56.290326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:56.291073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:56.333895 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:39:56.335415 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:56.344553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:56.345299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:56.347414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:56.348761 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:56.649247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:56.671985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:56.680486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:56.681904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c698273d-a5ad-4ac9-a94b-f675afe00e6f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.440225 Dec 03 03:39:56.682548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 388/756] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:56 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:56.910145 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c5ba76e8-0f4d-4152-b7d9-9c4a23be9f61 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584038 Dec 03 03:39:56.912115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 369/757] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:39:56 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:39:57.711071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:57.712458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:57.723680 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:57.724956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:57.726453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:57.727459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:57.992271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:58.008160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:58.015258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:58.016504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-095a0e64-ca88-4af3-95c9-7b3625fd1bed tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.318622 Dec 03 03:39:58.017097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 389/758] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:57 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:39:59.045014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:39:59.046136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:39:59.058606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:59.059830 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:59.065001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:39:59.065001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:39:59.321861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:59.338916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:59.347338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:39:59.349084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-47ce7e24-bf34-417a-886a-b2e99c8891c0 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.315579 Dec 03 03:39:59.354421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 370/759] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:39:59 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:00.376248 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:00.376918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:00.386637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:00.387412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:00.388262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:00.388756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:00.634365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:00.649466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:00.655974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:00.657162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fabc345a-addb-4ab3-b892-7ff187279f22 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1739 microversion: 2.20 time: 0.290013 Dec 03 03:40:00.657747 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 390/760] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:00 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:01.682496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:01.683179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:01.693568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:01.694103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:01.694991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:01.695489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:01.982850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:01.997882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:02.005006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:02.006408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b8a4a14c-d3f5-4327-b315-dfcf242adc1d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1721 microversion: 2.20 time: 0.333800 Dec 03 03:40:02.007077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 371/761] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:01 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:03.032242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:03.032809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:03.041174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:03.041678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:03.042537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:03.043021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:03.273650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:03.299140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:03.305786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:03.307151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1d319427-69ed-44d0-9034-ef30b1723487 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1721 microversion: 2.20 time: 0.284043 Dec 03 03:40:03.308140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 391/762] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:03 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:04.331648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:04.332323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:04.340379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.340891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:04.341734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.342230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:04.568708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:04.583587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:04.590193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:04.591427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-eef43bff-6354-4077-a3f0-a8864e68f273 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1664 microversion: 2.20 time: 0.269083 Dec 03 03:40:04.592007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 372/763] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:04 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1664 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:04.618134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecac412-75f1-4ecf-b0b8-52629c38b9d9"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:04.619410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:04.627625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.628130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:04.628978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.629466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:04.931764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:04.933099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:04.941619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.942170 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:04.943418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:04.943916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.030815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a26593bc-7218-4acf-b6fc-2596aafea674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108457 Dec 03 03:40:05.031626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 373/764] 10.222.0.66 () {58 vars in 1292 bytes} [Thu Dec 3 03:40:04 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:05.047178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:05.047638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:05.055651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:05.056165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.057158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:05.057636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.108979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d30b1442-c776-4686-99c5-164d18f4fbe1 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.500512 Dec 03 03:40:05.115690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 392/765] 10.222.0.66 () {62 vars in 1354 bytes} [Thu Dec 3 03:40:04 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-volume_attachments => generated 188 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 03 03:40:05.141481 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-37f55b3f-8bcb-4423-96a0-4b07213693d4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a" status: 200 len: 194 microversion: 2.1 time: 0.103359 Dec 03 03:40:05.142543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 374/766] 10.222.0.66 () {58 vars in 1403 bytes} [Thu Dec 3 03:40:05 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:05.153192 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-7471d6ab-64bd-47e8-902f-7366d15636fc req-23024c07-67ab-4cd9-88aa-ed98bbdf3689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "name": "network-vif-unplugged", "status": "completed", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:05.160314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:05.160314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:05.174674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-7471d6ab-64bd-47e8-902f-7366d15636fc req-23024c07-67ab-4cd9-88aa-ed98bbdf3689 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:05.175184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-7471d6ab-64bd-47e8-902f-7366d15636fc req-23024c07-67ab-4cd9-88aa-ed98bbdf3689 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.196488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.compute.server_external_events [req-7471d6ab-64bd-47e8-902f-7366d15636fc req-23024c07-67ab-4cd9-88aa-ed98bbdf3689 service nova] Unable to find a host for instance f0194cfc-db6e-4023-b4cd-aaad443f3847. Dropping event network-vif-unplugged {{(pid=94250) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 03 03:40:05.197703 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-7471d6ab-64bd-47e8-902f-7366d15636fc req-23024c07-67ab-4cd9-88aa-ed98bbdf3689 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055950 Dec 03 03:40:05.198693 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 393/767] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:05 2020] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 03 03:40:05.240917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:05.241473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:05.249400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:05.249904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.250776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:05.251273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:05.959584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7da97e20-078a-4f31-81dd-f858b04dd812 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-volume_attachments/cecac412-75f1-4ecf-b0b8-52629c38b9d9" status: 202 len: 0 microversion: 2.20 time: 0.728832 Dec 03 03:40:05.960255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 375/768] 10.222.0.66 () {60 vars in 1447 bytes} [Thu Dec 3 03:40:05 2020] DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/os-volume_attachments/cecac412-75f1-4ecf-b0b8-52629c38b9d9 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:40:06.071284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:06.071902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:06.079618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.080117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:06.080951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.081436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:06.243604 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3bdf3cfc-08f6-417b-be22-a7f9bd99fb55 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action" status: 202 len: 0 microversion: 2.20 time: 0.181406 Dec 03 03:40:06.244026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 394/769] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Dec 3 03:40:06 2020] POST /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:40:06.258976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:06.259734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:06.268244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.268841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:06.269714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.270211 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:06.498937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:06.515385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:06.522589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:06.523790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-761af7b1-4c21-4d51-a85f-003640de18d6 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1672 microversion: 2.20 time: 0.275162 Dec 03 03:40:06.524369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 376/770] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:06 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:06.792945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fae03fe-15cb-415b-aeb0-793a6c6c7a69"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:06.794142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:06.802982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.803498 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:06.804357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:06.804856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:07.243905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d5ebd925-f6a3-4e29-a434-a480b6555417 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460712 Dec 03 03:40:07.245143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 395/771] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:40:06 2020] POST /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:07.549831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:07.550824 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:07.559640 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:07.560156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:07.561005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:07.561502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:07.952289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:07.968339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:07.975816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:07.977070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-56b03062-6b9e-4f11-b6c2-03ae5af3a22e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1674 microversion: 2.20 time: 0.437496 Dec 03 03:40:07.977667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 377/772] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:07 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1674 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:09.003138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:09.003923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:09.016874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:09.017379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:09.018349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:09.018857 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:09.312983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:09.332671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:09.350377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:09.351985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4a0a43b7-7a14-4b50-9f5a-6ee87ae5c706 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.359531 Dec 03 03:40:09.359837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 396/773] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:08 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:10.381740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:10.382666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:10.391231 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:10.391829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:10.392741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:10.393304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:10.654266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:10.680004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:10.686995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:10.688270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3ceda139-041e-481b-9767-4f7f85d77234 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.316339 Dec 03 03:40:10.689061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 378/774] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:10 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:11.717304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:11.717964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:11.727231 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:11.727712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:11.728784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:11.729250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:12.011406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:12.028451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:12.037034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:12.046305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3658e0cc-8af2-49ac-a134-085754f99be5 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.331034 Dec 03 03:40:12.046305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 397/775] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:11 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:40:13.064564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:13.065362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:13.073432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:13.073940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:13.074813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:13.075308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:13.317593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:13.333720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:13.341098 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:13.342364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-57462f67-c945-4d2d-8b3c-aab0624e5ce2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.286878 Dec 03 03:40:13.343859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 379/776] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:13 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:14.368197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:14.368792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:14.381347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:14.382311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:14.383158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:14.383653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:14.821279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:14.836947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:14.843564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:14.844938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c054e1de-d882-4954-bf5a-7fe923174c84 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.487450 Dec 03 03:40:14.845530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 398/777] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:14 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:15.870280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:15.871015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:15.879521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:15.880092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:15.880852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:15.881350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:16.140324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:16.161668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:16.169216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:16.170491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-77172cf9-135e-4774-941b-eb3d76ae19cd tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.309507 Dec 03 03:40:16.171089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 380/778] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:15 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:17.196526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:17.197172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:17.205633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:17.206151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:17.207043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:17.207539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:17.449396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:17.464309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:17.471108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:17.472308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8d684c8b-c64d-4f4f-83ac-193f86d5f2b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.285290 Dec 03 03:40:17.472893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 399/779] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:17 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:18.497257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:18.497911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:18.519219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:18.519738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:18.532482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:18.533758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:18.876909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:18.906116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:18.913846 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:18.915243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c2757904-7263-4488-86c3-8c80ad19d151 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.427175 Dec 03 03:40:18.915705 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 381/780] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:18 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:19.939419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:19.940103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:19.949059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:19.949578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:19.950468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:19.950975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:20.193164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:20.209034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:20.216346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:20.217570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c371d2dd-677f-43bb-85b1-ae2a1e6ec5ec tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.287359 Dec 03 03:40:20.218136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 400/781] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:19 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:21.244076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:21.244773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:21.252791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:21.253297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:21.254134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:21.254657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:21.475692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:21.491401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:21.500354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:21.501584 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-773e61f5-80bf-4643-a2d5-ae5def02803e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.267117 Dec 03 03:40:21.502178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 382/782] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:21 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:21.814258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1227873581", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:21.887341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] validate_networks() for None {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:40:21.966565 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:21.967811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:21.975793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:21.976408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:21.977247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:21.977736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.057181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-60fd1b7b-cd2e-4c5b-bda3-021f3b0cf99e tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.099975 Dec 03 03:40:22.057818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 383/783] 10.222.0.66 () {58 vars in 1292 bytes} [Thu Dec 3 03:40:21 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:22.168236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:40:22.168719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:40:22.169266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:40:22.169737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:40:22.170205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:40:22.180208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.180908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.181869 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.182637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.202027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Getting quotas for project d162495e78bf4a6087785f8a695b3dfa. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:40:22.206517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Getting quotas for user a5e4536f48754224a1f30e1f0c7e630b and project d162495e78bf4a6087785f8a695b3dfa. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:40:22.217985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:40:22.220667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:40:22.270051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-85aad733-2b59-43ff-a227-4acc63b52973 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465221 Dec 03 03:40:22.270765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 401/784] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:40:21 2020] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:40:22.286769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-be94181d-3f26-4e8b-936e-b39369da553c tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:22.287549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-be94181d-3f26-4e8b-936e-b39369da553c tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:22.335348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:22.336091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:22.344377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.344889 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.345739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.346229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.378779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-be94181d-3f26-4e8b-936e-b39369da553c tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:22.387939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-be94181d-3f26-4e8b-936e-b39369da553c tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1215 microversion: 2.1 time: 0.110334 Dec 03 03:40:22.388759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 384/785] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:22 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:22.428639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a340d207-ecf6-4ec5-a8a3-80f529061551 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a" status: 200 len: 194 microversion: 2.1 time: 0.102777 Dec 03 03:40:22.429535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 402/786] 10.222.0.66 () {58 vars in 1403 bytes} [Thu Dec 3 03:40:22 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:22.446490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:22.447050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:22.455782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.456293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.457138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.457638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.527684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:22.528356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:22.536870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.537730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.538676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:22.540387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:22.744554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-95b57bb1-d32c-429b-bb92-e0462e01cb33 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a" status: 202 len: 0 microversion: 2.1 time: 0.308220 Dec 03 03:40:22.745182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 385/787] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:40:22 2020] DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/cb4b7cc8-ceb6-4ccf-84a1-3dfa5f7a4b2a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:40:22.794296 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:22.809243 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:22.815839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:22.817063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6dfcba8c-a349-41d7-8881-67ad464d27b3 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.300017 Dec 03 03:40:22.817927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 403/788] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:22 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:40:23.412040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:23.412820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:23.422134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:23.422793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:23.423639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:23.424135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:23.564722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:23.574198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-660a66f2-2df7-49cd-aedc-5a85caaa6d46 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1267 microversion: 2.1 time: 0.172596 Dec 03 03:40:23.574845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 386/789] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:23 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:23.846004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:23.847551 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:23.859043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:23.859757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:23.860963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:23.861534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:24.128172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-3745b09c-f3d4-4619-b7bc-83f7fbe031d3 req-e0306901-7d25-4745-b8d1-22d4b1aaf3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "name": "network-vif-plugged", "status": "completed", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:24.136337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:24.136337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:24.146094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3745b09c-f3d4-4619-b7bc-83f7fbe031d3 req-e0306901-7d25-4745-b8d1-22d4b1aaf3e0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:24.146726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3745b09c-f3d4-4619-b7bc-83f7fbe031d3 req-e0306901-7d25-4745-b8d1-22d4b1aaf3e0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:24.165954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-3745b09c-f3d4-4619-b7bc-83f7fbe031d3 req-e0306901-7d25-4745-b8d1-22d4b1aaf3e0 service nova] Creating event network-vif-plugged:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:40:24.170524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-3745b09c-f3d4-4619-b7bc-83f7fbe031d3 req-e0306901-7d25-4745-b8d1-22d4b1aaf3e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052286 Dec 03 03:40:24.171289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 387/790] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:24 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:24.245452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:24.261480 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:24.268728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:24.270044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e4dfd5b4-84dd-4533-9721-c184a812525e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.436674 Dec 03 03:40:24.270899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 404/791] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:23 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:24.599690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:24.600556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:24.608913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:24.609411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:24.622599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:24.622599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:24.794495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:24.803426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8595732b-32ee-4f70-bf40-2daa42584627 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1273 microversion: 2.1 time: 0.213657 Dec 03 03:40:24.804550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 388/792] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:24 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:25.104231 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:25.104983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:25.112924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.113429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.114410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.114907 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.192051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c2ad7cde-86a8-49b6-b728-686eef0f410f tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/5fae03fe-15cb-415b-aeb0-793a6c6c7a69" status: 200 len: 194 microversion: 2.1 time: 0.097660 Dec 03 03:40:25.192919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 405/793] 10.222.0.66 () {58 vars in 1403 bytes} [Thu Dec 3 03:40:25 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/5fae03fe-15cb-415b-aeb0-793a6c6c7a69 => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:25.209472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:25.211068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:25.219759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.220276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.221134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.221625 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.295016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:25.295682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:25.305173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.305681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.306557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.307051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.523815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-31b4b069-0458-4339-a181-a545d4385e40 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/5fae03fe-15cb-415b-aeb0-793a6c6c7a69" status: 202 len: 0 microversion: 2.1 time: 0.323148 Dec 03 03:40:25.524851 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 389/794] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:40:25 2020] DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f/os-volume_attachments/5fae03fe-15cb-415b-aeb0-793a6c6c7a69 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:40:25.711957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:25.729314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:25.737358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:25.737723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b21a57c8-124f-497a-8307-2b7d1618f12b tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.452677 Dec 03 03:40:25.738515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 406/795] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:25 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 03 03:40:25.827999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:25.828765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:25.837229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.837736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:25.838614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:25.839105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:26.567324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:26.577471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27c9446d-05bd-4ef2-9530-cac4ed94564d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.760043 Dec 03 03:40:26.578078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 390/796] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:25 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:26.767477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:26.768032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:26.777987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:26.778687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:26.779532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:26.780224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.246034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:27.246966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:27.254939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.255443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.256278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.256763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.297974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:27.313954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:27.322366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:27.324036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-006702b0-be2b-4e8a-baeb-2053948b6e01 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1730 microversion: 2.20 time: 0.570646 Dec 03 03:40:27.324897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 407/797] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:26 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1730 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:27.342094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:40:27.344755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-ba047cc4-7481-4616-9858-76a7ed1c700c req-1a719b57-4ad6-40f8-a710-4001a53e33e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61113ff-a4a0-43f5-94c3-3da543a6ef0c", "tag": "288cde6c-a011-4eab-b937-313fd513758d"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:27.354549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:27.354549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:27.364233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ba047cc4-7481-4616-9858-76a7ed1c700c req-1a719b57-4ad6-40f8-a710-4001a53e33e0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.364835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ba047cc4-7481-4616-9858-76a7ed1c700c req-1a719b57-4ad6-40f8-a710-4001a53e33e0 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.386305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-ba047cc4-7481-4616-9858-76a7ed1c700c req-1a719b57-4ad6-40f8-a710-4001a53e33e0 service nova] Creating event network-changed:288cde6c-a011-4eab-b937-313fd513758d for instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c on hv-cinder-74915 Dec 03 03:40:27.392797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-ba047cc4-7481-4616-9858-76a7ed1c700c req-1a719b57-4ad6-40f8-a710-4001a53e33e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059714 Dec 03 03:40:27.394665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 408/798] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:27 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:27.474947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-648ba204-0ca7-4310-a382-b22f0ec33a81 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 204 len: 0 microversion: 2.1 time: 0.238698 Dec 03 03:40:27.475609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 391/799] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:40:27 2020] DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 03 03:40:27.491299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:27.492335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:27.501259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.501764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.502633 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.503119 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.603901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:27.604607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:27.612983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.613494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.614363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:27.614861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:27.982198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:27.991168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-143a8f82-3318-43dd-9db3-2d109be86e4c tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1672 microversion: 2.1 time: 0.509825 Dec 03 03:40:27.992569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 409/800] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:27 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1672 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:28.061804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:28.073569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-474a8691-591a-4e7c-a5a5-2b81564a971f tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.480408 Dec 03 03:40:28.074309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 392/801] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:27 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:28.349257 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:28.349925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:28.357772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:28.358298 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:28.359162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:28.359628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:28.814630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:28.829522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:28.836707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:28.837925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a1eba690-ee10-4cee-8e43-024a10c68e30 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1717 microversion: 2.20 time: 0.497911 Dec 03 03:40:28.838550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 410/802] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:40:28 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1717 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:40:29.016352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:29.017013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:29.024967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:29.025471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:29.026323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:29.026811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:29.098655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:29.099666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:29.108157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:29.108938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:29.109786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:29.110308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:29.669773 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:29.676412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:29.678617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-17f3bd3f-76d8-4efb-a25a-63ea87cdcd50 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.589237 Dec 03 03:40:29.679429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 411/803] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:29 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:29.685293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ac7902bb-c42f-4ebe-8e38-8ba21a6006c9 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1672 microversion: 2.1 time: 0.678452 Dec 03 03:40:29.685883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 393/804] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:29 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1672 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:30.703165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:30.703886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:30.709316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:30.711016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:30.712311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:30.712829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:30.713684 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:30.714176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:30.719198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:30.719478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:30.720355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:30.720842 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:31.006664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:31.016689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-551ed5b5-553a-4e64-b684-62d19fb3bb43 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1605 microversion: 2.1 time: 0.316723 Dec 03 03:40:31.017293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 394/805] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:30 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1605 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:40:31.263228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:31.273375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cc04e712-14a9-46cf-8b05-f5e5b3ba57da tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.579886 Dec 03 03:40:31.279457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 412/806] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:30 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:31.384961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d9878a8e-2291-4e1c-816d-82286fea4cd2 req-e80384fd-95ad-4469-b4d8-22069b555962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712b9cc1-374c-4057-8718-dc4ca8721c2f", "name": "network-vif-deleted", "tag": "63bd1359-9b5c-4d84-95f7-292d15ebcffe"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:31.396629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:31.396629 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:31.407061 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d9878a8e-2291-4e1c-816d-82286fea4cd2 req-e80384fd-95ad-4469-b4d8-22069b555962 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:31.407566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d9878a8e-2291-4e1c-816d-82286fea4cd2 req-e80384fd-95ad-4469-b4d8-22069b555962 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:31.428173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d9878a8e-2291-4e1c-816d-82286fea4cd2 req-e80384fd-95ad-4469-b4d8-22069b555962 service nova] Creating event network-vif-deleted:63bd1359-9b5c-4d84-95f7-292d15ebcffe for instance 712b9cc1-374c-4057-8718-dc4ca8721c2f on hv-cinder-74915 Dec 03 03:40:31.434606 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d9878a8e-2291-4e1c-816d-82286fea4cd2 req-e80384fd-95ad-4469-b4d8-22069b555962 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060245 Dec 03 03:40:31.435277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 395/807] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:32.041619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:32.042299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:32.050632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.051143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.051986 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.052478 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.134160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.134690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.135251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lazy-loading 'fault' on Instance uuid 712b9cc1-374c-4057-8718-dc4ca8721c2f {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:40:32.220363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7218059084f8b99e430b20b84bb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acd0b3a676a415b9224f87276c4423d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:32.230520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2d7421a1-b49f-4af5-87b9-0308ea751e87 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 200 len: 1327 microversion: 2.1 time: 0.198737 Dec 03 03:40:32.231129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 413/808] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:32 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 1327 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:32.299087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:32.300064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:32.309240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.309862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.310840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.311411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.547607 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:32.557948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-25918677-f75b-4771-a0e7-917e92485003 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.270139 Dec 03 03:40:32.558786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 396/809] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:32 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:32.655810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-601c5cb9-870f-4037-a2bf-19c2fd6652a9 req-e733182c-9f1e-42c3-b8eb-7f4e22f9c4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61113ff-a4a0-43f5-94c3-3da543a6ef0c", "name": "network-vif-plugged", "status": "completed", "tag": "288cde6c-a011-4eab-b937-313fd513758d"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:32.662935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:32.662935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:32.672815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-601c5cb9-870f-4037-a2bf-19c2fd6652a9 req-e733182c-9f1e-42c3-b8eb-7f4e22f9c4df service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:32.673319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-601c5cb9-870f-4037-a2bf-19c2fd6652a9 req-e733182c-9f1e-42c3-b8eb-7f4e22f9c4df service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:32.692602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-601c5cb9-870f-4037-a2bf-19c2fd6652a9 req-e733182c-9f1e-42c3-b8eb-7f4e22f9c4df service nova] Creating event network-vif-plugged:288cde6c-a011-4eab-b937-313fd513758d for instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c on hv-cinder-74915 Dec 03 03:40:32.700227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-601c5cb9-870f-4037-a2bf-19c2fd6652a9 req-e733182c-9f1e-42c3-b8eb-7f4e22f9c4df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054133 Dec 03 03:40:32.700942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 414/810] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:33.254452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:33.255120 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:33.263710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:33.264212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:33.265868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:33.266391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:33.323436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. Dec 03 03:40:33.324125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:33.325017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-070d5dfe-9771-44d1-ad08-c385a696ea92 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 404 len: 111 microversion: 2.1 time: 0.079906 Dec 03 03:40:33.325620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 397/811] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:33 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:33.341319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-53322936-b290-47a7-927e-aa4abf153d00 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '.version_select at 0x7fe915515f28>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:33.363779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-53322936-b290-47a7-927e-aa4abf153d00 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396838792" status: 202 len: 0 microversion: 2.1 time: 0.033051 Dec 03 03:40:33.364401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 415/812] 10.222.0.66 () {58 vars in 1208 bytes} [Thu Dec 3 03:40:33 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396838792 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:40:33.582582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:33.583262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:33.592661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:33.593163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:33.594005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:33.594516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:33.962868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:33.988975 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bae6db0d-b063-4099-b866-f7203c9e7eaa tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1315 microversion: 2.1 time: 0.416463 Dec 03 03:40:34.000128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 398/813] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:33 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:35.013961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:35.014794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:35.024080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.024595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.025456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.025957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.246977 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:35.256014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c87f5a75-5272-48b9-b705-434dd2d69004 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1465 microversion: 2.1 time: 0.251689 Dec 03 03:40:35.256617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 416/814] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:35 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:35.338444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:35.338995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:35.346859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.347371 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.348213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.348706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.421366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:40:35.548404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1485bdd9-a65e-4021-837f-2982eadd1259 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "DELETE /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 204 len: 0 microversion: 2.1 time: 0.219848 Dec 03 03:40:35.549662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 399/815] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:40:35 2020] DELETE /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:40:35.563263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:35.563925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:35.571960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.572466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.573304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:35.573792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:35.799492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:35.809114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6a24407d-4158-4251-bc8e-86be98e55963 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1471 microversion: 2.1 time: 0.254898 Dec 03 03:40:35.809704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 417/816] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:35 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:36.834077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:36.834879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:36.842848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:36.843353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:36.844182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:36.844674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.058656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:37.059223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:37.067515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:37.068031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.068898 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:37.069396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.070467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:37.079700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f89eb30d-fa50-42b3-b41b-d7e6d05dd21d tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1471 microversion: 2.1 time: 0.255242 Dec 03 03:40:37.080311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 400/817] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:36 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:37.127375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. Dec 03 03:40:37.127972 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:37.128899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-47bbcad6-158e-4fa6-b0de-5f1324f28654 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 404 len: 111 microversion: 2.1 time: 0.080866 Dec 03 03:40:37.129530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 418/818] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:40:37 2020] DELETE /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:37.144644 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:37.145301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 712b9cc1-374c-4057-8718-dc4ca8721c2f] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:37.153588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:37.154122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.154980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:37.155482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.209749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. Dec 03 03:40:37.210520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 712b9cc1-374c-4057-8718-dc4ca8721c2f could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:37.211447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-daf87c8e-bdbd-46ca-8ddb-9cf8a67822a4 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f" status: 404 len: 111 microversion: 2.1 time: 0.076238 Dec 03 03:40:37.212262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 401/819] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:37 2020] GET /compute/v2.1/servers/712b9cc1-374c-4057-8718-dc4ca8721c2f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:37.588151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-ecb6fdfd-96b3-4ed0-a2d6-2aedb3ecf8aa req-bfd20cf2-927a-4791-93d6-4fe96889fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61113ff-a4a0-43f5-94c3-3da543a6ef0c", "name": "network-vif-unplugged", "status": "completed", "tag": "288cde6c-a011-4eab-b937-313fd513758d"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:37.595591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:37.595591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:37.605725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ecb6fdfd-96b3-4ed0-a2d6-2aedb3ecf8aa req-bfd20cf2-927a-4791-93d6-4fe96889fe1a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:37.606223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-ecb6fdfd-96b3-4ed0-a2d6-2aedb3ecf8aa req-bfd20cf2-927a-4791-93d6-4fe96889fe1a service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:37.625159 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-ecb6fdfd-96b3-4ed0-a2d6-2aedb3ecf8aa req-bfd20cf2-927a-4791-93d6-4fe96889fe1a service nova] Creating event network-vif-unplugged:288cde6c-a011-4eab-b937-313fd513758d for instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c on hv-cinder-74915 Dec 03 03:40:37.630674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-ecb6fdfd-96b3-4ed0-a2d6-2aedb3ecf8aa req-bfd20cf2-927a-4791-93d6-4fe96889fe1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052867 Dec 03 03:40:37.631643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 419/820] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:37 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:38.104942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:38.105617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:38.113594 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.114146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.115038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.115532 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.477653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:38.478334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:38.486845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.487355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.488214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.488714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.543729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. Dec 03 03:40:38.544401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:38.545320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b0b54bea-e9d6-4030-acc9-8174e4938fed tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 404 len: 111 microversion: 2.1 time: 0.078328 Dec 03 03:40:38.545943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 420/821] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:40:38 2020] DELETE /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 03 03:40:38.560309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:38.560984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] [instance: 8ac04b0b-7889-4479-916f-167720d1c630] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:38.568797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.569990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.570939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:38.571434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:38.627432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] HTTP exception thrown: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. Dec 03 03:40:38.628110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] Returning 404 to user: Instance 8ac04b0b-7889-4479-916f-167720d1c630 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:38.629027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9efea7fc-54f9-497b-b4e8-16639a10b674 tempest-AttachVolumeTestJSON-1492895919 tempest-AttachVolumeTestJSON-1492895919] 10.222.0.66 "GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630" status: 404 len: 111 microversion: 2.1 time: 0.078335 Dec 03 03:40:38.629647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 421/822] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:38 2020] GET /compute/v2.1/servers/8ac04b0b-7889-4479-916f-167720d1c630 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:38.678328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:38.688261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cdc49d3b-b483-4703-b020-6a2507240335 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1471 microversion: 2.1 time: 0.593461 Dec 03 03:40:38.689162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 402/823] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:38 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1471 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:39.333891 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-038f18a1-8b06-42b3-b932-24066db325c4 req-62494b8c-b5ba-4db0-9fc3-e5825897ebf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61113ff-a4a0-43f5-94c3-3da543a6ef0c", "name": "network-vif-deleted", "tag": "288cde6c-a011-4eab-b937-313fd513758d"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:39.343291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:40:39.343291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:40:39.354385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-038f18a1-8b06-42b3-b932-24066db325c4 req-62494b8c-b5ba-4db0-9fc3-e5825897ebf4 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:39.354886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-038f18a1-8b06-42b3-b932-24066db325c4 req-62494b8c-b5ba-4db0-9fc3-e5825897ebf4 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:39.375085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-038f18a1-8b06-42b3-b932-24066db325c4 req-62494b8c-b5ba-4db0-9fc3-e5825897ebf4 service nova] Creating event network-vif-deleted:288cde6c-a011-4eab-b937-313fd513758d for instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c on hv-cinder-74915 Dec 03 03:40:39.381432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-038f18a1-8b06-42b3-b932-24066db325c4 req-62494b8c-b5ba-4db0-9fc3-e5825897ebf4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058465 Dec 03 03:40:39.385731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 422/824] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:40:39 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:40:39.711930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:39.712587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:39.720435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:39.720935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:39.721762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:39.722340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:39.807007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:39.807506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:39.808009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lazy-loading 'fault' on Instance uuid c61113ff-a4a0-43f5-94c3-3da543a6ef0c {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:40:39.894459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e4536f48754224a1f30e1f0c7e630b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd162495e78bf4a6087785f8a695b3dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:40:39.906832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6ebfdfec-9e90-4044-9113-2bfd4e0b4871 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 200 len: 1305 microversion: 2.1 time: 0.204704 Dec 03 03:40:39.907528 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 403/825] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:39 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:40:40.932260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:40.933040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] [instance: c61113ff-a4a0-43f5-94c3-3da543a6ef0c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:40:40.941382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:40.941871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:40.942973 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:40:40.943691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:40:40.998991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] HTTP exception thrown: Instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c could not be found. Dec 03 03:40:40.999667 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] Returning 404 to user: Instance c61113ff-a4a0-43f5-94c3-3da543a6ef0c could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:41.000655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-86737292-7847-4e31-b687-f9f40196de64 tempest-VolumesNegativeTest-2044852756 tempest-VolumesNegativeTest-2044852756] 10.222.0.66 "GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c" status: 404 len: 111 microversion: 2.1 time: 0.079133 Dec 03 03:40:41.001253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 423/826] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:40:40 2020] GET /compute/v2.1/servers/c61113ff-a4a0-43f5-94c3-3da543a6ef0c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:47.888008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cf2ebd6f-9132-434a-bb58-443bff6acb23 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Action: 'create', calling method: .version_select at 0x7fe9156998c8>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1429630542", "metadata": {"Type": "work"}}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:47.889790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cf2ebd6f-9132-434a-bb58-443bff6acb23 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:47.890792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cf2ebd6f-9132-434a-bb58-443bff6acb23 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172103 Dec 03 03:40:47.891744 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 404/827] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Dec 3 03:40:47 2020] POST /compute/v2.1/os-volumes => generated 127 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 03:40:47.906987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6adbc113-9613-443c-81d1-f07175cdbce5 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Action: 'create', calling method: .version_select at 0x7fe91559eea0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-347671037", "metadata": {"Type": "work"}}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:47.908552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6adbc113-9613-443c-81d1-f07175cdbce5 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:47.909417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6adbc113-9613-443c-81d1-f07175cdbce5 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012369 Dec 03 03:40:47.909995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 424/828] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Dec 3 03:40:47 2020] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 03:40:47.925621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8527cf30-9d25-4d9c-94ec-3260d6afbfb0 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Action: 'create', calling method: .version_select at 0x7fe915458d90>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-170640673", "metadata": {"Type": "work"}}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:40:47.927009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8527cf30-9d25-4d9c-94ec-3260d6afbfb0 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:47.927865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8527cf30-9d25-4d9c-94ec-3260d6afbfb0 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011589 Dec 03 03:40:47.929818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 405/829] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Dec 3 03:40:47 2020] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 03:40:47.945639 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0c044f4a-ee4c-46bf-8bbb-0a8d026bd29f tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Calling method '.version_select at 0x7fe9153fa7b8>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:48.016365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-0c044f4a-ee4c-46bf-8bbb-0a8d026bd29f tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] HTTP exception thrown: Volume tempest-invalid-593518373 could not be found. Dec 03 03:40:48.017023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0c044f4a-ee4c-46bf-8bbb-0a8d026bd29f tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 404 to user: Volume tempest-invalid-593518373 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:48.017919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0c044f4a-ee4c-46bf-8bbb-0a8d026bd29f tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-593518373" status: 404 len: 98 microversion: 2.1 time: 0.082609 Dec 03 03:40:48.018579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 425/830] 10.222.0.66 () {58 vars in 1205 bytes} [Thu Dec 3 03:40:47 2020] DELETE /compute/v2.1/os-volumes/tempest-invalid-593518373 => generated 98 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 03 03:40:48.034291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9c444f6c-8f3c-4889-a2a6-3594af3942b3 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009338 Dec 03 03:40:48.034827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 406/831] 10.222.0.66 () {58 vars in 1130 bytes} [Thu Dec 3 03:40:48 2020] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 03 03:40:48.050660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3b433916-4f77-47df-8c12-8567d8a8fb1a tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009353 Dec 03 03:40:48.051162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 426/832] 10.222.0.66 () {58 vars in 1127 bytes} [Thu Dec 3 03:40:48 2020] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 03 03:40:48.065831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c2beda58-3ce8-44b9-8304-61c8eb189044 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Calling method '.version_select at 0x7fe915458e18>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:48.137034 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-c2beda58-3ce8-44b9-8304-61c8eb189044 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] HTTP exception thrown: Volume 2cfdee2a-9a2d-4dac-a2e4-568c2522d806 could not be found. Dec 03 03:40:48.137967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c2beda58-3ce8-44b9-8304-61c8eb189044 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 404 to user: Volume 2cfdee2a-9a2d-4dac-a2e4-568c2522d806 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:48.138931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c2beda58-3ce8-44b9-8304-61c8eb189044 tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/2cfdee2a-9a2d-4dac-a2e4-568c2522d806" status: 404 len: 109 microversion: 2.1 time: 0.082098 Dec 03 03:40:48.139568 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 407/833] 10.222.0.66 () {58 vars in 1238 bytes} [Thu Dec 3 03:40:48 2020] DELETE /compute/v2.1/os-volumes/2cfdee2a-9a2d-4dac-a2e4-568c2522d806 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:40:48.154799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-70b8aa07-05b4-4f99-b030-a2a7b1e50bda tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Calling method '.version_select at 0x7fe9153fa840>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:40:48.229212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-70b8aa07-05b4-4f99-b030-a2a7b1e50bda tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] HTTP exception thrown: Volume 3653313e-dcf3-405f-8ba1-86e62d15dd7c could not be found. Dec 03 03:40:48.229876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-70b8aa07-05b4-4f99-b030-a2a7b1e50bda tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] Returning 404 to user: Volume 3653313e-dcf3-405f-8ba1-86e62d15dd7c could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:40:48.230815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-70b8aa07-05b4-4f99-b030-a2a7b1e50bda tempest-VolumesNegativeTest-523906441 tempest-VolumesNegativeTest-523906441] 10.222.0.66 "GET /compute/v2.1/os-volumes/3653313e-dcf3-405f-8ba1-86e62d15dd7c" status: 404 len: 109 microversion: 2.1 time: 0.085299 Dec 03 03:40:48.231417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 427/834] 10.222.0.66 () {58 vars in 1235 bytes} [Thu Dec 3 03:40:48 2020] GET /compute/v2.1/os-volumes/3653313e-dcf3-405f-8ba1-86e62d15dd7c => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:04.563467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe9156999d8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1492416280"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:04.593334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for project 53824ced637f4561a36b7f7aacf50bec. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:41:04.597525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for user 6661ac0dfe6e4cec897fc10b23a7c8fe and project 53824ced637f4561a36b7f7aacf50bec. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:41:04.973752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for project 53824ced637f4561a36b7f7aacf50bec. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:41:04.979172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for user 6661ac0dfe6e4cec897fc10b23a7c8fe and project 53824ced637f4561a36b7f7aacf50bec. Resources: {'key_pairs'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:41:04.995570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6fb18df7-f252-4fa3-aff7-a07db4fed801 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.667893 Dec 03 03:41:05.001196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 408/835] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Dec 3 03:41:04 2020] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:05.014215 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d5a27ff1-1f15-4211-ab92-e628965697df tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe9153fab70>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-385853502", "description": "tempest-TestVolumeBootPattern-385853502 description"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:05.253305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d5a27ff1-1f15-4211-ab92-e628965697df tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.250543 Dec 03 03:41:05.258265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 428/836] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Dec 3 03:41:05 2020] POST /compute/v2.1/os-security-groups => generated 249 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:05.271329 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d30744cc-0a72-4172-a4d7-b04275eac58f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe915699b70>, body: {"security_group_rule": {"parent_group_id": "57c2dd8e-b1a2-4d1f-bc11-1e75d7985578", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:05.552659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d30744cc-0a72-4172-a4d7-b04275eac58f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.290762 Dec 03 03:41:05.553407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 409/837] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:41:05 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:05.569903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3aa187d-fdc8-4950-9be3-f48bce0488ca tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe915515268>, body: {"security_group_rule": {"parent_group_id": "57c2dd8e-b1a2-4d1f-bc11-1e75d7985578", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:05.819355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3aa187d-fdc8-4950-9be3-f48bce0488ca tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.258490 Dec 03 03:41:05.820058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 429/838] 10.222.0.66 () {60 vars in 1185 bytes} [Thu Dec 3 03:41:05 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:07.590721 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:07.591284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:07.600181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:07.600699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:07.602578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:07.603085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:07.678672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:41:07.807008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5d87eb98-4849-4d7c-8976-a2ead104f2c7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 204 len: 0 microversion: 2.20 time: 0.226907 Dec 03 03:41:07.808456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 410/839] 10.222.0.66 () {60 vars in 1270 bytes} [Thu Dec 3 03:41:07 2020] DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 03 03:41:07.823367 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:07.824031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:07.832129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:07.832632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:07.833464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:07.833952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:08.074749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:08.092731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:08.099616 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:08.100829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6e06a577-cefb-441f-9b08-a642bfd6ac4c tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.287762 Dec 03 03:41:08.101663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 430/840] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:07 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:41:09.127160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:09.127958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:09.138088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:09.138630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:09.139501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:09.139997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:09.389379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:09.404512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:09.411366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:09.412781 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6df82d67-b7ad-4066-a76d-007a552b2462 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.295737 Dec 03 03:41:09.413507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 411/841] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:09 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:41:10.306850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-60bf6b35-a171-4bd7-b1d4-9dd31cae272b req-7d5608a7-42e3-42a1-82f1-388f0059ce15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "name": "network-vif-unplugged", "status": "completed", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:10.314706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:10.314706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:10.331599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-60bf6b35-a171-4bd7-b1d4-9dd31cae272b req-7d5608a7-42e3-42a1-82f1-388f0059ce15 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:10.332264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-60bf6b35-a171-4bd7-b1d4-9dd31cae272b req-7d5608a7-42e3-42a1-82f1-388f0059ce15 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:10.352178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-60bf6b35-a171-4bd7-b1d4-9dd31cae272b req-7d5608a7-42e3-42a1-82f1-388f0059ce15 service nova] Creating event network-vif-unplugged:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:41:10.359101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-60bf6b35-a171-4bd7-b1d4-9dd31cae272b req-7d5608a7-42e3-42a1-82f1-388f0059ce15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061802 Dec 03 03:41:10.360176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 431/842] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:10 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:10.439782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:10.440550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:10.449286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:10.449784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:10.450653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:10.451143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:10.685571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:10.702328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:10.710114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:10.711436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2dfa13ac-df83-41ac-9ba3-371179e4c64a tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.282655 Dec 03 03:41:10.712002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 412/843] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:10 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:41:11.737811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:11.738836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:11.748685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:11.749195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:11.750063 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:11.750588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:12.235831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:12.283596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:12.297293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:12.299646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3966a545-b4da-4f2a-894f-ee1f5663de53 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1723 microversion: 2.20 time: 0.571338 Dec 03 03:41:12.301083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 432/844] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:11 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:41:12.755183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f03eb74f-8062-4823-b0e7-e1e37aa3d541 req-f344d934-e735-4db5-917c-78c2b93555f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0194cfc-db6e-4023-b4cd-aaad443f3847", "name": "network-vif-deleted", "tag": "79ff5038-3e00-4314-9303-6339e41003a8"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:12.767685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:12.767685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:12.791386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f03eb74f-8062-4823-b0e7-e1e37aa3d541 req-f344d934-e735-4db5-917c-78c2b93555f1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:12.793748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f03eb74f-8062-4823-b0e7-e1e37aa3d541 req-f344d934-e735-4db5-917c-78c2b93555f1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:12.822003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f03eb74f-8062-4823-b0e7-e1e37aa3d541 req-f344d934-e735-4db5-917c-78c2b93555f1 service nova] Creating event network-vif-deleted:79ff5038-3e00-4314-9303-6339e41003a8 for instance f0194cfc-db6e-4023-b4cd-aaad443f3847 on hv-cinder-74915 Dec 03 03:41:12.828245 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f03eb74f-8062-4823-b0e7-e1e37aa3d541 req-f344d934-e735-4db5-917c-78c2b93555f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090229 Dec 03 03:41:12.829094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 413/845] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:41:13.343798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:13.345242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:13.357487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:13.360782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:13.360782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:13.363283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:13.478912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:13.480785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:13.480785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lazy-loading 'fault' on Instance uuid f0194cfc-db6e-4023-b4cd-aaad443f3847 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:41:13.596698 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:13.612892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:13.620072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797715e424754a368052bb6405c5f5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb64f2deda143e78ec3cd403b83d6ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:13.621550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-722939e6-5c90-46a7-b54a-ad678bee740f tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 200 len: 1371 microversion: 2.20 time: 0.293347 Dec 03 03:41:13.622677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 433/846] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:13 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 03 03:41:13.689343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '.version_select at 0x7fe915699158>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:14.225318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:14.235330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:14.235984 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:14.236771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:14.237546 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:14.306339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Acquired lock "refresh_cache-7d1cee60-e1d6-4b2c-a218-27203e9065f6" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:41:14.649603 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:14.650479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:14.659074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:14.659432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:14.660345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:14.660845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:14.718286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. Dec 03 03:41:14.719350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:14.720556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ce43c60b-aa43-47a6-934b-1ad9c71a113d tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 404 len: 111 microversion: 2.20 time: 0.081689 Dec 03 03:41:14.721406 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 434/847] 10.222.0.66 () {60 vars in 1267 bytes} [Thu Dec 3 03:41:14 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 03 03:41:14.736497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ea538989-cc82-4faf-a152-64d08accbcf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '.version_select at 0x7fe9153fa0d0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:14.762135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ea538989-cc82-4faf-a152-64d08accbcf2 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937417455" status: 204 len: 0 microversion: 2.20 time: 0.035771 Dec 03 03:41:14.763286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 435/848] 10.222.0.66 () {60 vars in 1252 bytes} [Thu Dec 3 03:41:14 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937417455 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 03 03:41:17.190734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:41:17.205182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c0d36960-7731-4098-bdfd-ebce19863ee9 req-656d2c27-aa78-40ce-a936-96a712b179b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:17.216459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:17.216459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:17.227080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c0d36960-7731-4098-bdfd-ebce19863ee9 req-656d2c27-aa78-40ce-a936-96a712b179b2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:17.227841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c0d36960-7731-4098-bdfd-ebce19863ee9 req-656d2c27-aa78-40ce-a936-96a712b179b2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:17.251343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c0d36960-7731-4098-bdfd-ebce19863ee9 req-656d2c27-aa78-40ce-a936-96a712b179b2 service nova] Creating event network-changed:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:41:17.256408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c0d36960-7731-4098-bdfd-ebce19863ee9 req-656d2c27-aa78-40ce-a936-96a712b179b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061103 Dec 03 03:41:17.257046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 436/849] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:17 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:17.979660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Updating instance_info_cache with network_info: [{"id": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70", "address": "fa:16:3e:cb:96:14", "network": {"id": "f60403ca-ab4d-44ff-a662-f33a863f9753", "bridge": "br-int", "label": "tempest-TestShelveInstance-1145940515-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1f4fcf788cc14d2eb287d7397fb1be0b", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapec2a7db3-d8", "ovs_interfaceid": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:41:17.991405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Releasing lock "refresh_cache-7d1cee60-e1d6-4b2c-a218-27203e9065f6" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:41:17.993193 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c38f57b3-25c3-49c9-ad63-c6aed9b3ff4b tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/ddbc4675-895f-47b5-9f7e-a3e530a30a70" status: 202 len: 0 microversion: 2.1 time: 4.541981 Dec 03 03:41:17.993844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 414/850] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:41:13 2020] DELETE /compute/v2.1/os-floating-ips/ddbc4675-895f-47b5-9f7e-a3e530a30a70 => generated 0 bytes in 4544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:41:18.008917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:18.009576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:18.017989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:18.018567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:18.019412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:18.019908 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:18.092772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:41:18.240858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9daacbd4-ef27-4fa9-be81-a0b9007245c7 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "DELETE /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 204 len: 0 microversion: 2.1 time: 0.241913 Dec 03 03:41:18.241621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 437/851] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:41:17 2020] DELETE /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:41:18.255732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:18.256453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:18.270919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:18.271429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:18.272284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:18.272800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:18.931325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:18.940259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9039f278-cb58-4685-a6c7-8fc61503676c tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1456 microversion: 2.1 time: 0.693981 Dec 03 03:41:18.940873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 415/852] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:18 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1456 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:19.344767 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:19.345426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:19.354492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.355007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:19.355848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.356345 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:19.410366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. Dec 03 03:41:19.411042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:19.411950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fe280db6-9495-48bf-aceb-f01c56dfda4e tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 404 len: 111 microversion: 2.1 time: 0.078027 Dec 03 03:41:19.412558 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 438/853] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:41:19 2020] DELETE /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:19.427009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:19.427868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: f0194cfc-db6e-4023-b4cd-aaad443f3847] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:19.436082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.436593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:19.437439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.437933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:19.491624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. Dec 03 03:41:19.492447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance f0194cfc-db6e-4023-b4cd-aaad443f3847 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:19.493370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-aad9e330-ca73-4134-8926-557f29875804 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847" status: 404 len: 111 microversion: 2.1 time: 0.075655 Dec 03 03:41:19.493976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 416/854] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:19 2020] GET /compute/v2.1/servers/f0194cfc-db6e-4023-b4cd-aaad443f3847 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:19.965360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:19.966041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:19.973876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.974446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:19.975301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:19.975795 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:20.206400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:20.216816 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d08a5818-075a-4230-8e41-4c09178a9896 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1456 microversion: 2.1 time: 0.261672 Dec 03 03:41:20.217402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 439/855] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:19 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1456 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:21.241575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:21.243048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:21.250960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:21.251477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:21.252315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:21.252810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:21.470596 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:21.480234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-39a7f258-2866-423d-b895-e0fadb7d4b41 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1456 microversion: 2.1 time: 0.248366 Dec 03 03:41:21.480832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 417/856] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:21 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1456 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:22.504473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:22.505040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:22.513931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:22.514466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:22.515317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:22.515810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:22.749716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:22.760858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-46d0b4a4-aac1-49c9-98b8-a31c71e98f79 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1456 microversion: 2.1 time: 0.265594 Dec 03 03:41:22.761763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 440/857] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:22 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1456 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:22.976910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:22.978041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:22.983126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-f44acac6-8bcc-4f9d-8c6f-994430b33ddc req-d73ee47e-aa12-462e-badd-005091f166ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:23.000858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:23.000858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:23.004209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.006435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.007888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.008894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.029160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f44acac6-8bcc-4f9d-8c6f-994430b33ddc req-d73ee47e-aa12-462e-badd-005091f166ab service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.029964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-f44acac6-8bcc-4f9d-8c6f-994430b33ddc req-d73ee47e-aa12-462e-badd-005091f166ab service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.048825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-f44acac6-8bcc-4f9d-8c6f-994430b33ddc req-d73ee47e-aa12-462e-badd-005091f166ab service nova] Creating event network-vif-unplugged:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:41:23.060814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-f44acac6-8bcc-4f9d-8c6f-994430b33ddc req-d73ee47e-aa12-462e-badd-005091f166ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100516 Dec 03 03:41:23.064051 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 418/858] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:22 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:23.076425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. Dec 03 03:41:23.077148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:23.078071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5ddca230-5aba-4017-84be-947c13452691 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 404 len: 111 microversion: 2.1 time: 0.110534 Dec 03 03:41:23.078743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 441/859] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:41:22 2020] DELETE /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:23.095555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:23.096380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] [instance: 428a81d4-be89-4e0b-8c3e-ec4ca703cd13] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:23.105637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.106452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.107504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.108194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.163171 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] HTTP exception thrown: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. Dec 03 03:41:23.163841 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] Returning 404 to user: Instance 428a81d4-be89-4e0b-8c3e-ec4ca703cd13 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:23.165410 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0fdc1214-134d-43ef-9c5d-2d5c085d6ec7 tempest-AttachVolumeShelveTestJSON-1735404255 tempest-AttachVolumeShelveTestJSON-1735404255] 10.222.0.66 "GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13" status: 404 len: 111 microversion: 2.1 time: 0.081311 Dec 03 03:41:23.166015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 419/860] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:23 2020] GET /compute/v2.1/servers/428a81d4-be89-4e0b-8c3e-ec4ca703cd13 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:23.785186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:23.786431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:23.796273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.797413 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.798616 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.799283 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.973216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d7ead37e-07aa-4536-8008-a7cab0e10980 req-d6669b91-232c-4198-95e8-3f19b2756919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1cee60-e1d6-4b2c-a218-27203e9065f6", "name": "network-vif-deleted", "tag": "ec2a7db3-d8b3-45f0-b192-2d8670bbcf70"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:23.979194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:23.981025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:23.981025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:23.989901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d7ead37e-07aa-4536-8008-a7cab0e10980 req-d6669b91-232c-4198-95e8-3f19b2756919 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:23.990727 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d7ead37e-07aa-4536-8008-a7cab0e10980 req-d6669b91-232c-4198-95e8-3f19b2756919 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:23.994971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7608d0c2-14d7-41f8-af47-cb2b2ba80882 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1384 microversion: 2.1 time: 0.218966 Dec 03 03:41:23.995592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 442/861] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:23 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1384 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:41:24.009910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d7ead37e-07aa-4536-8008-a7cab0e10980 req-d6669b91-232c-4198-95e8-3f19b2756919 service nova] Creating event network-vif-deleted:ec2a7db3-d8b3-45f0-b192-2d8670bbcf70 for instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 on hv-cinder-74915 Dec 03 03:41:24.016361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d7ead37e-07aa-4536-8008-a7cab0e10980 req-d6669b91-232c-4198-95e8-3f19b2756919 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053370 Dec 03 03:41:24.017252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 420/862] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:23 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:25.019322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:25.020035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:25.028364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:25.029020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:25.029872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:25.030417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:25.110665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:25.111087 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:25.111592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lazy-loading 'fault' on Instance uuid 7d1cee60-e1d6-4b2c-a218-27203e9065f6 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:41:25.201357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408d9f0256a6410bb861e24242e13f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4fcf788cc14d2eb287d7397fb1be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:25.211208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fc0247a4-fc95-4e10-a1c5-d738b244ab48 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 200 len: 1225 microversion: 2.1 time: 0.201974 Dec 03 03:41:25.212300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 443/863] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:25 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:26.236808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:26.237650 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] [instance: 7d1cee60-e1d6-4b2c-a218-27203e9065f6] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:26.246573 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:26.247084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:26.247921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:26.248411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:26.301692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] HTTP exception thrown: Instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 could not be found. Dec 03 03:41:26.302405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Returning 404 to user: Instance 7d1cee60-e1d6-4b2c-a218-27203e9065f6 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:41:26.303431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b5aed7a3-56b5-46ff-b900-e26bced4fb00 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6" status: 404 len: 111 microversion: 2.1 time: 0.077912 Dec 03 03:41:26.309499 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 421/864] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:26 2020] GET /compute/v2.1/servers/7d1cee60-e1d6-4b2c-a218-27203e9065f6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:41:26.320361 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e37ad9f8-8d0c-4530-87b2-63581cee5d74 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '.version_select at 0x7fe915457840>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:26.891746 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e37ad9f8-8d0c-4530-87b2-63581cee5d74 tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/828afee8-3795-4747-9cb4-ad2a6ebe0ed5" status: 202 len: 0 microversion: 2.1 time: 0.580417 Dec 03 03:41:26.892365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 444/865] 10.222.0.66 () {58 vars in 1262 bytes} [Thu Dec 3 03:41:26 2020] DELETE /compute/v2.1/os-security-groups/828afee8-3795-4747-9cb4-ad2a6ebe0ed5 => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:41:26.908169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5730417f-7b40-42c6-b489-69e062ee9fde tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] Calling method '.version_select at 0x7fe916118e18>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:26.932304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5730417f-7b40-42c6-b489-69e062ee9fde tempest-TestShelveInstance-2006632833 tempest-TestShelveInstance-2006632833] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1839724600" status: 202 len: 0 microversion: 2.1 time: 0.034807 Dec 03 03:41:26.933010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 422/866] 10.222.0.66 () {58 vars in 1244 bytes} [Thu Dec 3 03:41:26 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1839724600 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:41:29.361372 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1137784427", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1492416280", "security_groups": [{"name": "tempest-TestVolumeBootPattern-385853502"}], "block_device_mapping_v2": [{"uuid": "14b256c8-e23b-490f-ad9d-cf805d9a1971", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:29.858664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] validate_networks() for [('fbc7e55f-d22e-4329-970b-a9a3c37bd3aa', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:41:32.323940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:41:32.324836 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:41:32.325391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:41:32.325855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:41:32.326352 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:41:32.335729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:32.337016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:32.339765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:32.341853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:32.370580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:41:32.374987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for user 6661ac0dfe6e4cec897fc10b23a7c8fe and project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:41:32.497040 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:41:32.499736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14b256c8-e23b-490f-ad9d-cf805d9a1971',volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:41:32.702592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-167c94fa-ca23-4330-a0b8-819895119add tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 3.358893 Dec 03 03:41:32.703699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 445/867] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:41:29 2020] POST /compute/v2.1/servers => generated 412 bytes in 3361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:41:32.725935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d48ce5af-8f09-45fe-97eb-6a9395f9b733 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:32.726653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d48ce5af-8f09-45fe-97eb-6a9395f9b733 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:32.880033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d48ce5af-8f09-45fe-97eb-6a9395f9b733 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:32.900656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d48ce5af-8f09-45fe-97eb-6a9395f9b733 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1095 microversion: 2.1 time: 0.190073 Dec 03 03:41:32.901926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 423/868] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:32 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1095 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:33.925853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:33.926942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:33.937123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:33.937775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:33.938945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:33.939654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:34.101338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:34.116138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6d8e20fe-1cd3-459a-98ed-7fccc3f826a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1193 microversion: 2.1 time: 0.200266 Dec 03 03:41:34.117868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 446/869] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:33 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1193 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:35.143227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:35.144457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:35.155597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:35.156476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:35.157534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:35.158524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:35.603956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:35.619443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ddb121f1-db8e-4cbc-b203-3002903a5b9d tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1211 microversion: 2.1 time: 0.487266 Dec 03 03:41:35.623430 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 424/870] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:35 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1211 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:36.644268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:36.650591 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:36.682272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:36.683088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:36.684293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:36.685162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:37.122411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:37.132563 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-88cf5524-624e-4c4c-93ab-87567fafeffb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.499280 Dec 03 03:41:37.144677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 447/871] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:36 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:38.158058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:38.166929 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:38.184661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-116169601", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "f3549cf6-ed17-48c1-b65b-f417f27a00cc"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:38.188037 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:38.188545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:38.189403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:38.189893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:38.277748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] validate_networks() for [('f3549cf6-ed17-48c1-b65b-f417f27a00cc', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:41:38.932095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:38.941380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3f228176-60bd-4409-b528-15767a054c9c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.793165 Dec 03 03:41:38.942377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 448/872] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:38 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:38.953719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-40563b3e-f28a-4ffa-bd7e-9fe8fa8d154c req-ee6d6bb3-e96d-4c39-b0b7-64c0f25be961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be1987f-dbd5-4de9-836b-903aa98376a4", "tag": "01a7c05b-85fc-46aa-9257-cbcd90973e50"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:38.962519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:38.962519 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:38.973709 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-40563b3e-f28a-4ffa-bd7e-9fe8fa8d154c req-ee6d6bb3-e96d-4c39-b0b7-64c0f25be961 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:38.974452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-40563b3e-f28a-4ffa-bd7e-9fe8fa8d154c req-ee6d6bb3-e96d-4c39-b0b7-64c0f25be961 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:38.994318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-40563b3e-f28a-4ffa-bd7e-9fe8fa8d154c req-ee6d6bb3-e96d-4c39-b0b7-64c0f25be961 service nova] Creating event network-changed:01a7c05b-85fc-46aa-9257-cbcd90973e50 for instance 1be1987f-dbd5-4de9-836b-903aa98376a4 on hv-cinder-74915 Dec 03 03:41:39.000202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-40563b3e-f28a-4ffa-bd7e-9fe8fa8d154c req-ee6d6bb3-e96d-4c39-b0b7-64c0f25be961 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056164 Dec 03 03:41:39.001172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 449/873] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:38 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:39.657618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:41:39.658095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:41:39.658646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:41:39.659117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:41:39.659599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:41:39.669501 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:39.669991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:39.671088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:39.671769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:39.693588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:41:39.699859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for user 71edf5bf04244184946f7068094c1e77 and project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:41:39.716162 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:41:39.718911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:41:39.776010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-35ca19de-2597-4730-bf42-75928fd28849 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813236 Dec 03 03:41:39.776964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 425/874] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:41:37 2020] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:41:39.831577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e8389fcb-a718-4a2e-8525-2ff0f21b2060 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:39.832994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e8389fcb-a718-4a2e-8525-2ff0f21b2060 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:39.964838 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e8389fcb-a718-4a2e-8525-2ff0f21b2060 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:39.968419 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:39.970287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:39.990318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e8389fcb-a718-4a2e-8525-2ff0f21b2060 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1217 microversion: 2.1 time: 0.202431 Dec 03 03:41:39.991182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 450/875] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:39 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:40.004833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:40.005364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:40.006227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:40.007312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:40.564764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:40.578764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d612c5f0-56fd-4ac3-9e14-8e8e8556cdb0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.620437 Dec 03 03:41:40.580554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 426/876] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:39 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:41.019273 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:41.027089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:41.048792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:41.049508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:41.050859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:41.051704 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:41.295114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:41.320089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c431e89f-6061-4c99-a19e-efdd32af5516 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1269 microversion: 2.1 time: 0.310608 Dec 03 03:41:41.321108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 451/877] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:41 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1269 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:41.607707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:41.610844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:41.630507 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:41.631885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:41.633442 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:41.635868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:42.342437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:42.345728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:42.350463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:42.355185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c48cf8a4-662a-42d1-9b10-cf23927d8ae7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.760189 Dec 03 03:41:42.356223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 427/878] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:41 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:42.376702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:42.377227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:42.378097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:42.378628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:42.791612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:42.802833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9f7e2c2f-bdd9-40db-8772-0efc20b6cdb7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1275 microversion: 2.1 time: 0.467286 Dec 03 03:41:42.804067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 452/879] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:42 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1275 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:41:43.379349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:43.380724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:43.391859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:43.392685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:43.393725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:43.394598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:43.826728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:43.827801 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:43.836578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:43.837600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:43.838717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:43.839271 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:44.127962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:44.148883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3fe7e4eb-9791-4e42-9c91-c7bacb827114 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.778422 Dec 03 03:41:44.150046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 428/880] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:43 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:44.505531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:44.521697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dda7ad22-8f87-4dc2-a762-e17d0542f39d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.704267 Dec 03 03:41:44.522879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 453/881] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:43 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:45.172566 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:45.173465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:45.183324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:45.183999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:45.185017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:45.185757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:45.547092 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:45.549334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:45.560965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:45.561729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:45.562881 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:45.563539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:45.766175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:45.776293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-162c6e06-f07c-4f9a-8841-c5440246519c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.614326 Dec 03 03:41:45.777321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 429/882] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:45 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:45.788538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-24f36845-77cc-4a03-8b8a-958494ef34d7 req-57e5f93f-8683-4787-a152-c2f3c6b17365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d47a6d-bc7c-4e50-b812-de4b30a745c4", "tag": "e97f0326-6157-47c0-a379-98169e3d6388"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:45.796784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:45.796784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:45.807876 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-24f36845-77cc-4a03-8b8a-958494ef34d7 req-57e5f93f-8683-4787-a152-c2f3c6b17365 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:45.808462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-24f36845-77cc-4a03-8b8a-958494ef34d7 req-57e5f93f-8683-4787-a152-c2f3c6b17365 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:45.828965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-24f36845-77cc-4a03-8b8a-958494ef34d7 req-57e5f93f-8683-4787-a152-c2f3c6b17365 service nova] Creating event network-changed:e97f0326-6157-47c0-a379-98169e3d6388 for instance f1d47a6d-bc7c-4e50-b812-de4b30a745c4 on hv-cinder-74915 Dec 03 03:41:45.838651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-24f36845-77cc-4a03-8b8a-958494ef34d7 req-57e5f93f-8683-4787-a152-c2f3c6b17365 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059373 Dec 03 03:41:45.839903 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 430/883] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:45 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:46.038562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:46.048202 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-833c5ea2-3029-4281-91df-0609b303b09d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.511796 Dec 03 03:41:46.055708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 454/884] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:45 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:46.804543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:46.806128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:46.823775 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:46.824474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:46.825517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:46.826129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:47.076756 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:47.077580 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:47.087328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:47.087328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:47.088130 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:47.088717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:47.309083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:47.319806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7fff0de5-6308-4d79-a458-92a083ff77d1 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.527828 Dec 03 03:41:47.330029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 431/885] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:46 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:47.783805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:47.793763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b67239f2-6be7-402b-9439-b0eb7fe04665 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.729532 Dec 03 03:41:47.794570 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 455/886] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:47 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:48.344800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:48.345457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:48.354028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:48.354587 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:48.355434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:48.355933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:48.597114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:48.606574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-321a719e-279f-4fe6-9726-39a648737b08 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.271942 Dec 03 03:41:48.607175 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 432/887] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:48 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:48.816751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:48.817426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:48.825833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:48.826408 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:48.827262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:48.827760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:49.134412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:49.143813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4c739a53-47ac-4da3-b926-c3f12c69b11f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.336267 Dec 03 03:41:49.144407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 456/888] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:48 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:49.630680 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:49.631309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:49.640600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:49.641106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:49.641954 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:49.642483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:49.876921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:49.886569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f6eea726-551d-4999-899b-a9acaa532907 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.265272 Dec 03 03:41:49.887124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 433/889] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:49 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:50.168535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:50.169219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:50.177592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:50.178422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:50.179439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:50.180178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:50.419813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:50.430163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a8517cd6-e88e-4622-bef6-58fdcb1e47b0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.271880 Dec 03 03:41:50.430953 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-af3809eb-f592-479e-9c60-ac99ada50d11 req-6f11e246-cc54-482f-9ada-5e0c4a81c49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be1987f-dbd5-4de9-836b-903aa98376a4", "name": "network-vif-plugged", "status": "completed", "tag": "01a7c05b-85fc-46aa-9257-cbcd90973e50"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:50.431180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 457/890] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:50 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:50.438122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:50.438122 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:50.447855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-af3809eb-f592-479e-9c60-ac99ada50d11 req-6f11e246-cc54-482f-9ada-5e0c4a81c49e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:50.448571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-af3809eb-f592-479e-9c60-ac99ada50d11 req-6f11e246-cc54-482f-9ada-5e0c4a81c49e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:50.467014 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-af3809eb-f592-479e-9c60-ac99ada50d11 req-6f11e246-cc54-482f-9ada-5e0c4a81c49e service nova] Creating event network-vif-plugged:01a7c05b-85fc-46aa-9257-cbcd90973e50 for instance 1be1987f-dbd5-4de9-836b-903aa98376a4 on hv-cinder-74915 Dec 03 03:41:50.472554 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-af3809eb-f592-479e-9c60-ac99ada50d11 req-6f11e246-cc54-482f-9ada-5e0c4a81c49e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053084 Dec 03 03:41:50.478508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 434/891] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:50 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:50.910302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:50.910958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:50.921188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:50.921695 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:50.922559 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:50.923050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:51.143423 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:51.153379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6bad8d62-2a0e-46ea-a7ff-9834d0c88db5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1273 microversion: 2.1 time: 0.252249 Dec 03 03:41:51.153950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 458/892] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:50 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:51.454579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:51.455349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:51.463461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:51.463966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:51.464798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:51.465285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:51.690076 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:51.699593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d89d3f76-1ba3-4f3f-ae3a-667a5683d0b2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.255399 Dec 03 03:41:51.700207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 435/893] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:51 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:52.176001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:52.176675 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:52.185875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.186344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.187203 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.187700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.419244 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:52.429016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-73c91b34-ec4a-4d34-b53f-84ccf99c1be4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1460 microversion: 2.1 time: 0.262107 Dec 03 03:41:52.430208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 459/894] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:52 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1460 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:52.457400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:52.458000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:52.465943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.466488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.467324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.467813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.528912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-09117fe6-0df0-4e6d-9f28-10a5d2082d69 req-b44b1210-b22a-407a-9864-0a71dea6a0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d47a6d-bc7c-4e50-b812-de4b30a745c4", "name": "network-vif-plugged", "status": "completed", "tag": "e97f0326-6157-47c0-a379-98169e3d6388"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:52.535670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:52.535670 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:52.545022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-09117fe6-0df0-4e6d-9f28-10a5d2082d69 req-b44b1210-b22a-407a-9864-0a71dea6a0ad service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.545516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-09117fe6-0df0-4e6d-9f28-10a5d2082d69 req-b44b1210-b22a-407a-9864-0a71dea6a0ad service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.569678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-09117fe6-0df0-4e6d-9f28-10a5d2082d69 req-b44b1210-b22a-407a-9864-0a71dea6a0ad service nova] Creating event network-vif-plugged:e97f0326-6157-47c0-a379-98169e3d6388 for instance f1d47a6d-bc7c-4e50-b812-de4b30a745c4 on hv-cinder-74915 Dec 03 03:41:52.575252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-09117fe6-0df0-4e6d-9f28-10a5d2082d69 req-b44b1210-b22a-407a-9864-0a71dea6a0ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055473 Dec 03 03:41:52.575980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 460/895] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:52 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:41:52.689598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:52.698730 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ec4fc925-2dc0-4aa3-88aa-ce11f360d32a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1460 microversion: 2.1 time: 0.250676 Dec 03 03:41:52.699350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 436/896] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:52 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1460 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:52.722466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:52.722882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-37b8e08d-f96f-4f55-b0ad-a505de0f7df9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe9154577b8>, body: {"pool": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:52.723072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:52.731791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.732302 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:52.733148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:52.733643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:53.077235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:53.087085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-39635de1-c0a8-46b8-a28a-cf16d9f154f9 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.373536 Dec 03 03:41:53.087688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 437/897] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:52 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:54.110392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:54.111067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:54.119093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:54.119611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:54.120444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:54.120936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:54.580669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:54.590156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9e8b07ee-226d-4509-85b9-9a2b48e746a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.488515 Dec 03 03:41:54.590156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 438/898] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:54 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:41:55.017380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-37b8e08d-f96f-4f55-b0ad-a505de0f7df9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.304289 Dec 03 03:41:55.018038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 461/899] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Dec 3 03:41:52 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:55.034833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.144"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:55.036046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:55.044880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:55.045395 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:55.046279 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:55.046804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:55.117820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Acquired lock "refresh_cache-1be1987f-dbd5-4de9-836b-903aa98376a4" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:41:55.612959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:55.613788 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:55.623882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:55.624400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:55.625280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:55.625790 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:56.206933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:56.216294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de750571-27d5-4e6b-a07d-321b5ca0dc03 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.612695 Dec 03 03:41:56.216868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 462/900] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:55 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:41:57.244152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:57.245184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:57.253597 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:57.254102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:57.255207 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:57.255697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:57.261808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:41:57.714117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:57.723659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-841f4e66-238a-4d84-968b-a84de12db4af tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.491241 Dec 03 03:41:57.724284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 463/901] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:57 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:41:57.745626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-5fab9d6b-20b8-431b-81d5-050d463f86cc req-8f8de0c1-2202-4fa0-9608-c3c86da74ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be1987f-dbd5-4de9-836b-903aa98376a4", "tag": "01a7c05b-85fc-46aa-9257-cbcd90973e50"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:41:57.752947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:41:57.752947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:41:57.763825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5fab9d6b-20b8-431b-81d5-050d463f86cc req-8f8de0c1-2202-4fa0-9608-c3c86da74ab7 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:57.764331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-5fab9d6b-20b8-431b-81d5-050d463f86cc req-8f8de0c1-2202-4fa0-9608-c3c86da74ab7 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:57.784339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-5fab9d6b-20b8-431b-81d5-050d463f86cc req-8f8de0c1-2202-4fa0-9608-c3c86da74ab7 service nova] Creating event network-changed:01a7c05b-85fc-46aa-9257-cbcd90973e50 for instance 1be1987f-dbd5-4de9-836b-903aa98376a4 on hv-cinder-74915 Dec 03 03:41:57.791113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-5fab9d6b-20b8-431b-81d5-050d463f86cc req-8f8de0c1-2202-4fa0-9608-c3c86da74ab7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055188 Dec 03 03:41:57.791931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 464/902] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:41:57 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:41:58.485393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Updating instance_info_cache with network_info: [{"id": "01a7c05b-85fc-46aa-9257-cbcd90973e50", "address": "fa:16:3e:7c:aa:ce", "network": {"id": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-148563040-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "53824ced637f4561a36b7f7aacf50bec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap01a7c05b-85", "ovs_interfaceid": "01a7c05b-85fc-46aa-9257-cbcd90973e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:41:58.500699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Releasing lock "refresh_cache-1be1987f-dbd5-4de9-836b-903aa98376a4" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:41:58.501887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-31483191-99c2-42d2-b25c-7718b45c03d0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4/action" status: 202 len: 0 microversion: 2.1 time: 3.476018 Dec 03 03:41:58.502653 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 439/903] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:41:55 2020] POST /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4/action => generated 0 bytes in 3478 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 03:41:58.749000 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:41:58.749692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:41:58.758080 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:58.758658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:58.759503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:41:58.760032 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:41:58.986978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:41:58.998697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c031742a-7814-4981-9339-c6469be83e45 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1317 microversion: 2.1 time: 0.259988 Dec 03 03:41:58.999556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 465/904] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:41:58 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:00.022617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:00.023293 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:00.032449 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:00.032963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:00.033814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:00.034379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:00.264074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:00.272922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9635ab42-c8e9-4287-826a-62a45813c6b3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1506 microversion: 2.1 time: 0.260143 Dec 03 03:42:00.274491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 440/905] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:00 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:01.865974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b729138-b44e-4740-96a3-f9de176b88e5"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:01.867883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:01.875943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:01.876467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:01.877299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:01.877796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:02.274008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d691f4db-7317-4ec9-a3a8-972d5850f05e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416358 Dec 03 03:42:02.274941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 466/906] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:42:01 2020] POST /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:10.244654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816830149", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "f3549cf6-ed17-48c1-b65b-f417f27a00cc"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:10.321191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] validate_networks() for [('f3549cf6-ed17-48c1-b65b-f417f27a00cc', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:42:10.905307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:42:10.905815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:42:10.906400 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:42:10.906983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:42:10.907443 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:42:10.917009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:10.917491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:10.918386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:10.918873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:10.937617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:42:10.941906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for user 71edf5bf04244184946f7068094c1e77 and project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:42:10.952958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:42:10.955545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:42:11.006312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-197c5260-4fc8-431e-b702-b6e3e5856b1f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771675 Dec 03 03:42:11.006966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 441/907] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:42:10 2020] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:42:11.025313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-17418029-ebdd-4aaf-bd95-b177912634f6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:11.026079 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-17418029-ebdd-4aaf-bd95-b177912634f6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:11.153699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-17418029-ebdd-4aaf-bd95-b177912634f6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:11.161780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-17418029-ebdd-4aaf-bd95-b177912634f6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1218 microversion: 2.1 time: 0.147561 Dec 03 03:42:11.162454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 467/908] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:11 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:12.187809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:12.189297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:12.198150 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:12.198691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:12.199548 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:12.200042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:12.341647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:12.354978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e939c0f2-49a8-4f97-beb5-efa4cda2af48 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1270 microversion: 2.1 time: 0.177826 Dec 03 03:42:12.355752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 442/909] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:12 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:13.378712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:13.380078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:13.393387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:13.394407 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:13.395490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:13.396217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:13.572619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:13.582769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dfaf883f-ca97-4991-9d91-509efb037b40 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1276 microversion: 2.1 time: 0.213109 Dec 03 03:42:13.583299 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 468/910] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:13 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:14.606825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:14.607505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:14.615493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:14.616267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:14.617758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:14.618280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:15.017010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:15.028310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8f76e94b-dbb5-4ac5-8c0e-4d45400521de tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.430429 Dec 03 03:42:15.029397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 443/911] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:14 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:15.696058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-94df9e79-27db-4bb9-8bfd-4348ace955d5 req-65996f49-8002-42ea-a66b-003115b2580c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200cf6f2-e56b-4405-9227-8cab3717d3c4", "tag": "c0531fe2-9f85-40bc-ac76-735de4473139"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:15.702764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:15.702764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:15.711887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-94df9e79-27db-4bb9-8bfd-4348ace955d5 req-65996f49-8002-42ea-a66b-003115b2580c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:15.712338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-94df9e79-27db-4bb9-8bfd-4348ace955d5 req-65996f49-8002-42ea-a66b-003115b2580c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:15.730517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-94df9e79-27db-4bb9-8bfd-4348ace955d5 req-65996f49-8002-42ea-a66b-003115b2580c service nova] Creating event network-changed:c0531fe2-9f85-40bc-ac76-735de4473139 for instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 on hv-cinder-74915 Dec 03 03:42:15.735380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-94df9e79-27db-4bb9-8bfd-4348ace955d5 req-65996f49-8002-42ea-a66b-003115b2580c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048332 Dec 03 03:42:15.736289 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 469/912] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:15 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:16.060172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:16.060850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:16.068948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:16.069468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:16.070343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:16.070853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:16.449297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:16.458309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a1d5a7fa-26e2-467e-8853-5d3efff8fbb3 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.407464 Dec 03 03:42:16.459082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 444/913] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:16 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:17.483843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:17.484616 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:17.492729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:17.493242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:17.494088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:17.494614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:17.726832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:17.735681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a7c0bcd4-8fda-4337-9dac-69101fc41210 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.262809 Dec 03 03:42:17.736294 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 470/914] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:17 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:18.759134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:18.759792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:18.768011 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:18.768510 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:18.769331 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:18.769815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:18.996577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:19.005585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a300e44b-473f-4d2e-b398-23cac2dbc6a0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.256252 Dec 03 03:42:19.006196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 445/915] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:18 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:20.029277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:20.029955 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:20.037822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:20.038370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:20.039218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:20.040769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:20.262306 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:20.271588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3c46e37-bd76-4065-87f2-a7eb2d2c8437 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.252065 Dec 03 03:42:20.272181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 471/916] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:20 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:20.670167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-231f8923-d713-4232-85da-4f9d4ebc7515 req-ced4b457-7283-48df-a82c-d98159e882c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200cf6f2-e56b-4405-9227-8cab3717d3c4", "name": "network-vif-plugged", "status": "completed", "tag": "c0531fe2-9f85-40bc-ac76-735de4473139"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:20.677654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:20.677654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:20.687595 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-231f8923-d713-4232-85da-4f9d4ebc7515 req-ced4b457-7283-48df-a82c-d98159e882c3 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:20.688095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-231f8923-d713-4232-85da-4f9d4ebc7515 req-ced4b457-7283-48df-a82c-d98159e882c3 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:20.705837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-231f8923-d713-4232-85da-4f9d4ebc7515 req-ced4b457-7283-48df-a82c-d98159e882c3 service nova] Creating event network-vif-plugged:c0531fe2-9f85-40bc-ac76-735de4473139 for instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 on hv-cinder-74915 Dec 03 03:42:20.713463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-231f8923-d713-4232-85da-4f9d4ebc7515 req-ced4b457-7283-48df-a82c-d98159e882c3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053387 Dec 03 03:42:20.714932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 446/917] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:21.294865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:21.295402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:21.303344 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:21.303854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:21.304691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:21.305832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:21.527683 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:21.536420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fa1425e7-2112-428b-b528-2a7d2b78c27e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1318 microversion: 2.1 time: 0.251121 Dec 03 03:42:21.537022 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 472/918] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:21 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:22.560491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:22.561281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:22.570447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:22.570965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:22.571834 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:22.572335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:22.808848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:22.818070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-429ef4ab-ee68-49a1-be33-a6940429b071 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1508 microversion: 2.1 time: 0.267484 Dec 03 03:42:22.818899 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 447/919] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:22 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:22.843999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b729138-b44e-4740-96a3-f9de176b88e5"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:22.845314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:22.853512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:22.854016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:22.855425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:22.855962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:23.271457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Invalid input received: Invalid volume: Volume 5b729138-b44e-4740-96a3-f9de176b88e5 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-f5d6b8f8-5914-4663-a342-e70de9f6655d) Dec 03 03:42:23.272315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 400 to user: Invalid input received: Invalid volume: Volume 5b729138-b44e-4740-96a3-f9de176b88e5 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-f5d6b8f8-5914-4663-a342-e70de9f6655d) {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:42:23.273234 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0fa0060f-3abf-4292-bafd-959096f65d23 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.440563 Dec 03 03:42:23.273865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 473/920] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:42:22 2020] POST /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4/os-volume_attachments => generated 279 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 03 03:42:23.389692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:23.390250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:23.398198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:23.398745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:23.399582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:23.400070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:23.668780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-87ca3329-426a-410f-b489-ab731a7f0080 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4/os-volume_attachments/5b729138-b44e-4740-96a3-f9de176b88e5" status: 202 len: 0 microversion: 2.1 time: 0.288620 Dec 03 03:42:23.669457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 448/921] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:42:23 2020] DELETE /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4/os-volume_attachments/5b729138-b44e-4740-96a3-f9de176b88e5 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:42:27.216027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1062881161", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "f3549cf6-ed17-48c1-b65b-f417f27a00cc"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:27.292590 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] validate_networks() for [('f3549cf6-ed17-48c1-b65b-f417f27a00cc', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:42:28.089388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:42:28.089858 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:42:28.090411 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:42:28.091227 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:42:28.091966 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:42:28.101042 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:28.101542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:28.102453 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:28.102927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:28.125890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:42:28.131814 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for user 71edf5bf04244184946f7068094c1e77 and project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:42:28.143600 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:42:28.146384 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:42:28.202125 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6d68efc9-d556-422d-9a0e-52f924b8ece8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997052 Dec 03 03:42:28.202996 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 474/922] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:42:27 2020] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:42:28.220701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0b290ba1-538e-47b0-bb58-21d32c9a10bd tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:28.222155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0b290ba1-538e-47b0-bb58-21d32c9a10bd tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:28.314158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0b290ba1-538e-47b0-bb58-21d32c9a10bd tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:28.322148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0b290ba1-538e-47b0-bb58-21d32c9a10bd tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1218 microversion: 2.1 time: 0.112348 Dec 03 03:42:28.322792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 449/923] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:28 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:29.346872 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:29.347552 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:29.357412 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:29.357927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:29.358812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:29.359314 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:29.562720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:29.573208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2730ed4f-c254-48bf-8461-cf07f6a4b727 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1278 microversion: 2.1 time: 0.236543 Dec 03 03:42:29.574808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 475/924] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:29 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:30.598728 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:30.599386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:30.616490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:30.617001 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:30.617869 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:30.618389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:31.013093 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:31.021926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9f731b13-557c-4861-b202-c47f2cc44299 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1318 microversion: 2.1 time: 0.433109 Dec 03 03:42:31.022578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 450/925] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:30 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:32.047341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:32.048715 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:32.056968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:32.057474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:32.058326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:32.058887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:32.143664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c822e287-2741-478c-9250-81bdc1d2875d req-0f63a62d-46a2-4181-9211-ca8f2c11797d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498b3941-d2e3-47c7-8698-80f4700cf25c", "tag": "4d230fe7-cb42-4476-be5b-58a08b33d70f"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:32.151388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:32.151388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:32.161278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c822e287-2741-478c-9250-81bdc1d2875d req-0f63a62d-46a2-4181-9211-ca8f2c11797d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:32.161777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c822e287-2741-478c-9250-81bdc1d2875d req-0f63a62d-46a2-4181-9211-ca8f2c11797d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:32.185452 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c822e287-2741-478c-9250-81bdc1d2875d req-0f63a62d-46a2-4181-9211-ca8f2c11797d service nova] Creating event network-changed:4d230fe7-cb42-4476-be5b-58a08b33d70f for instance 498b3941-d2e3-47c7-8698-80f4700cf25c on hv-cinder-74915 Dec 03 03:42:32.192593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c822e287-2741-478c-9250-81bdc1d2875d req-0f63a62d-46a2-4181-9211-ca8f2c11797d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058763 Dec 03 03:42:32.193247 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 451/926] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:32 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:32.715427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:32.724343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-89bdfa21-9a39-4943-a198-226f06752a2b tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1318 microversion: 2.1 time: 0.688343 Dec 03 03:42:32.724976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 476/927] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:32 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:33.749717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:33.750477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:33.758585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:33.759104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:33.759956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:33.760462 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:34.143865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:34.153555 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-97b58d82-1857-4618-804c-4e9a50d24472 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1318 microversion: 2.1 time: 0.414122 Dec 03 03:42:34.154441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 452/928] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:33 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:35.177549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:35.178228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:35.186766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:35.187284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:35.188121 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:35.188608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:35.421284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:35.430301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a8d4973b-c4d8-4278-9d2c-12bf7187b06c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1318 microversion: 2.1 time: 0.262564 Dec 03 03:42:35.430812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 477/929] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:35 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:35.861019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-e65c239e-5925-4007-bfec-36bd98b3e69d req-1bf4ec3d-e10d-4b6e-83fb-1b2e6c05d5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498b3941-d2e3-47c7-8698-80f4700cf25c", "name": "network-vif-plugged", "status": "completed", "tag": "4d230fe7-cb42-4476-be5b-58a08b33d70f"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:35.867845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:35.867845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:35.877075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e65c239e-5925-4007-bfec-36bd98b3e69d req-1bf4ec3d-e10d-4b6e-83fb-1b2e6c05d5b2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:35.877577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e65c239e-5925-4007-bfec-36bd98b3e69d req-1bf4ec3d-e10d-4b6e-83fb-1b2e6c05d5b2 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:35.896970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-e65c239e-5925-4007-bfec-36bd98b3e69d req-1bf4ec3d-e10d-4b6e-83fb-1b2e6c05d5b2 service nova] Creating event network-vif-plugged:4d230fe7-cb42-4476-be5b-58a08b33d70f for instance 498b3941-d2e3-47c7-8698-80f4700cf25c on hv-cinder-74915 Dec 03 03:42:35.902766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-e65c239e-5925-4007-bfec-36bd98b3e69d req-1bf4ec3d-e10d-4b6e-83fb-1b2e6c05d5b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050799 Dec 03 03:42:35.904223 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 453/930] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:35 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:36.454336 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:36.454887 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:36.462765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:36.463277 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:36.464115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:36.464698 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:36.691438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:36.701267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-27dc60c6-8c1d-43cd-8741-17c80a8cd1e0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1318 microversion: 2.1 time: 0.256328 Dec 03 03:42:36.701870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 478/931] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:36 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:37.726745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:37.727605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:37.738043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:37.738609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:37.739476 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:37.739942 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:37.966334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:37.975190 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-0ede769c-2f19-4d65-84ef-7641dee40284 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1508 microversion: 2.1 time: 0.259114 Dec 03 03:42:37.975789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 454/932] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:37 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:39.555885 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:39.557149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:39.565719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:39.566221 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:39.567070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:39.567557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:39.981674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8a5460f7-b609-4acb-a3f1-3e845f234122 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435154 Dec 03 03:42:39.982338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 479/933] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:42:39 2020] POST /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:47.848556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:47.849742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:47.857762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:47.858341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:47.859124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:47.859611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:47.935538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Invalid volume: volume 6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3 already attached Dec 03 03:42:47.936212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 400 to user: Invalid volume: volume 6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3 already attached {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:42:47.937305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d946c73-ea50-4b8d-9bf0-e656f3cc8fc6 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.099164 Dec 03 03:42:47.937799 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 455/934] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:42:47 2020] POST /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments => generated 120 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 03 03:42:48.058317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:48.059379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:48.071707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:48.072222 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:48.073067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:48.073561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:48.340605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-51b56266-7e22-4d72-b062-65b6a6aa9ee0 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments/6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3" status: 202 len: 0 microversion: 2.1 time: 0.292417 Dec 03 03:42:48.341615 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 480/935] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:42:48 2020] DELETE /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c/os-volume_attachments/6a72fe0e-ddc1-4bd8-bb4c-d6d7c0bc47d3 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:42:49.615008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-748120119", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "f3549cf6-ed17-48c1-b65b-f417f27a00cc"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:49.690385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] validate_networks() for [('f3549cf6-ed17-48c1-b65b-f417f27a00cc', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:42:50.260897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:42:50.261374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:42:50.261920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:42:50.262428 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:42:50.262896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:42:50.272091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:50.272601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:50.273470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:50.273959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:50.293026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:42:50.297931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Getting quotas for user 71edf5bf04244184946f7068094c1e77 and project b073306a442b4c14b452213b4b59c308. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:42:50.309133 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:42:50.312592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:42:50.360959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de2add64-fdda-484f-88ab-946cdbff1fa5 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755031 Dec 03 03:42:50.361663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 456/936] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:42:49 2020] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:42:50.379262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2b66b249-a2bc-4c92-9c5c-0deb34677050 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:50.380016 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2b66b249-a2bc-4c92-9c5c-0deb34677050 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:50.471511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2b66b249-a2bc-4c92-9c5c-0deb34677050 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:50.480375 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2b66b249-a2bc-4c92-9c5c-0deb34677050 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1217 microversion: 2.1 time: 0.111778 Dec 03 03:42:50.480934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 481/937] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:50 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:51.506950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:51.507681 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:51.517230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:51.517748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:51.518611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:51.519301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:51.904840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:51.913802 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9dd80ca7-790d-4e54-b6b5-42ec09157628 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1277 microversion: 2.1 time: 0.419041 Dec 03 03:42:51.914402 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 457/938] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:51 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1277 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:42:52.939065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:52.939740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:52.947957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:52.948461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:52.949295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:52.949784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:53.418976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:53.428256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-49eee673-de24-45fa-85af-c9316050db52 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.499275 Dec 03 03:42:53.429010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 482/939] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:52 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:54.421236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-e34f4153-47e9-4c94-bc31-6a669490ab13 req-f1a1f8cc-877b-40fa-908a-024eddccf5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d203b9cd-d6a5-43b1-ab76-5939722924f4", "tag": "e3a1a426-7438-4883-83ff-34a74035469b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:54.428161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:54.428161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:54.438009 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e34f4153-47e9-4c94-bc31-6a669490ab13 req-f1a1f8cc-877b-40fa-908a-024eddccf5ec service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:54.438549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e34f4153-47e9-4c94-bc31-6a669490ab13 req-f1a1f8cc-877b-40fa-908a-024eddccf5ec service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:54.453182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:54.453855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:54.457960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-e34f4153-47e9-4c94-bc31-6a669490ab13 req-f1a1f8cc-877b-40fa-908a-024eddccf5ec service nova] Creating event network-changed:e3a1a426-7438-4883-83ff-34a74035469b for instance d203b9cd-d6a5-43b1-ab76-5939722924f4 on hv-cinder-74915 Dec 03 03:42:54.463105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:54.463748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:54.463873 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-e34f4153-47e9-4c94-bc31-6a669490ab13 req-f1a1f8cc-877b-40fa-908a-024eddccf5ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052646 Dec 03 03:42:54.464567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 458/940] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:54 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:54.464861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:54.465432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:54.886755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:54.895886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bcf820c3-376f-459c-b33c-ac80e3cbbf88 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.452705 Dec 03 03:42:54.896484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 483/941] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:54 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:55.920990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:55.921766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:55.930164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:55.930707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:55.931557 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:55.932050 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:56.158882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:56.167648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-35fce963-a481-4f52-998d-6270d94b945c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.257553 Dec 03 03:42:56.168242 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 459/942] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:55 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:57.192652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:57.193948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:57.203613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:57.204569 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:57.205516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:57.206450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:57.665020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:57.674759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a63e9e42-652d-4ff0-9154-a16de13d0c67 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.493469 Dec 03 03:42:57.675488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 484/943] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:57 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:58.447100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-2d690f51-ce51-4736-92b9-a69cf304adb1 req-58965e8a-c73b-4b4c-9414-831b670d9973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d203b9cd-d6a5-43b1-ab76-5939722924f4", "name": "network-vif-plugged", "status": "completed", "tag": "e3a1a426-7438-4883-83ff-34a74035469b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:42:58.454808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:42:58.454808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:42:58.463997 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2d690f51-ce51-4736-92b9-a69cf304adb1 req-58965e8a-c73b-4b4c-9414-831b670d9973 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:58.464496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2d690f51-ce51-4736-92b9-a69cf304adb1 req-58965e8a-c73b-4b4c-9414-831b670d9973 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:58.483218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-2d690f51-ce51-4736-92b9-a69cf304adb1 req-58965e8a-c73b-4b4c-9414-831b670d9973 service nova] Creating event network-vif-plugged:e3a1a426-7438-4883-83ff-34a74035469b for instance d203b9cd-d6a5-43b1-ab76-5939722924f4 on hv-cinder-74915 Dec 03 03:42:58.488129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-2d690f51-ce51-4736-92b9-a69cf304adb1 req-58965e8a-c73b-4b4c-9414-831b670d9973 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050977 Dec 03 03:42:58.488785 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 460/944] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:42:58 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:42:58.697823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:58.698420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:42:58.707450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:58.707960 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:58.708794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:42:58.709286 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:42:58.962309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:42:58.971820 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-736a9ad9-98ff-4c6d-b2e7-be15339370bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.283526 Dec 03 03:42:58.972425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 485/945] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:58 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:42:59.995553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:42:59.996319 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:00.005325 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:00.005823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:00.006676 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:00.007165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:00.241308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:00.250928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9f99beb2-2a1c-4710-9249-52dfc608af57 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1317 microversion: 2.1 time: 0.264987 Dec 03 03:43:00.251533 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 461/946] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:42:59 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:43:01.274579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:01.275229 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:01.283967 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:01.284467 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:01.285335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:01.285822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:01.508373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:01.517760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-85a428c3-f7aa-49bb-bdf5-3cfbc744a410 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1506 microversion: 2.1 time: 0.252473 Dec 03 03:43:01.518364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 486/947] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:01 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:03.092912 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20216c02-fc87-41f4-850f-a01f8e54b3d4"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:03.093946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:03.101897 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:03.102490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:03.103332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:03.103825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:03.517089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-25db2b26-692e-43a3-844e-34607cd6064d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "POST /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434035 Dec 03 03:43:03.517723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 462/948] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:43:03 2020] POST /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:11.543983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:11.544560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:11.553793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:11.554318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:11.555176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:11.555668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:11.827276 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6ae1a597-a096-4b07-994b-6b8e91abf43d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4/os-volume_attachments/20216c02-fc87-41f4-850f-a01f8e54b3d4" status: 202 len: 0 microversion: 2.1 time: 0.291679 Dec 03 03:43:11.827987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 487/949] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:43:11 2020] DELETE /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4/os-volume_attachments/20216c02-fc87-41f4-850f-a01f8e54b3d4 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:43:14.340380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:14.341028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:14.349957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:14.350489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:14.351317 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:14.351804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:14.422055 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:43:14.557800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e5f771cc-a891-4dfb-942d-a8420f6f312e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 204 len: 0 microversion: 2.1 time: 0.227123 Dec 03 03:43:14.558743 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 463/950] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:43:14 2020] DELETE /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:43:14.574353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:14.575148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:14.583992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:14.584525 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:14.585391 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:14.585890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:14.807194 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:14.816099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f79bd633-ac6b-45ad-9119-3cf37b3da4d8 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1512 microversion: 2.1 time: 0.251818 Dec 03 03:43:14.816646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 488/951] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:14 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:15.840383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:15.841146 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:15.849697 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:15.850195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:15.851065 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:15.851545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:16.074527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:16.083957 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2a662f25-b925-4e82-8137-6bb2294a5c7f tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1512 microversion: 2.1 time: 0.253202 Dec 03 03:43:16.084571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 464/952] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:15 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:17.108405 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:17.109096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:17.116924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:17.117434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:17.118308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:17.118807 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:17.276184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:17.285561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-65785b97-a33b-4842-91bf-12177c6ac9fb tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 200 len: 1470 microversion: 2.1 time: 0.187227 Dec 03 03:43:17.286155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 489/953] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:17 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:17.502250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-a3d38109-0b07-4306-92a9-7c3e3a99eadd req-6971aa1a-569b-4065-8578-0ee5b0b44406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d203b9cd-d6a5-43b1-ab76-5939722924f4", "name": "network-vif-deleted", "tag": "e3a1a426-7438-4883-83ff-34a74035469b"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:17.509048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:17.509048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:17.519757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a3d38109-0b07-4306-92a9-7c3e3a99eadd req-6971aa1a-569b-4065-8578-0ee5b0b44406 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:17.520261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a3d38109-0b07-4306-92a9-7c3e3a99eadd req-6971aa1a-569b-4065-8578-0ee5b0b44406 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:17.539466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-a3d38109-0b07-4306-92a9-7c3e3a99eadd req-6971aa1a-569b-4065-8578-0ee5b0b44406 service nova] Creating event network-vif-deleted:e3a1a426-7438-4883-83ff-34a74035469b for instance d203b9cd-d6a5-43b1-ab76-5939722924f4 on hv-cinder-74915 Dec 03 03:43:17.544374 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-a3d38109-0b07-4306-92a9-7c3e3a99eadd req-6971aa1a-569b-4065-8578-0ee5b0b44406 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052930 Dec 03 03:43:17.546021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 465/954] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:17 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:18.312174 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:18.312849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: d203b9cd-d6a5-43b1-ab76-5939722924f4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:18.320711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:18.321240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:18.322048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:18.322586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:18.375228 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Instance d203b9cd-d6a5-43b1-ab76-5939722924f4 could not be found. Dec 03 03:43:18.375888 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 404 to user: Instance d203b9cd-d6a5-43b1-ab76-5939722924f4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:43:18.376787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3e8c4a0c-6154-47d1-985e-3213f2473f28 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4" status: 404 len: 111 microversion: 2.1 time: 0.074397 Dec 03 03:43:18.377380 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 490/955] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:18 2020] GET /compute/v2.1/servers/d203b9cd-d6a5-43b1-ab76-5939722924f4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:43:19.639432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:19.640153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:19.648270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:19.648779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:19.649610 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:19.650103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:19.719878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:43:19.832982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dbe567ab-e20c-46ce-968a-d9368a9477a2 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 204 len: 0 microversion: 2.1 time: 0.203601 Dec 03 03:43:19.833538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 466/956] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:43:19 2020] DELETE /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:43:19.847754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:19.848421 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:19.856275 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:19.856771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:19.858353 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:19.858850 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:20.093447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:20.103332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9da90ae5-9ce7-4dcc-b05a-315fd7dbc45d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1514 microversion: 2.1 time: 0.265177 Dec 03 03:43:20.103935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 491/957] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:19 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:21.128806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:21.129567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:21.137426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:21.137926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:21.139520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:21.139981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:21.378618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:21.387598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d04b8fa8-d252-4c0d-844f-7f92cefac46e tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1514 microversion: 2.1 time: 0.268512 Dec 03 03:43:21.388136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 467/958] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:21 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:22.411479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:22.412143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:22.421106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:22.421617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:22.422521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:22.423062 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:22.579516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:22.588981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bf4f6657-ff25-4720-808f-22aa6ca6b054 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 200 len: 1472 microversion: 2.1 time: 0.186854 Dec 03 03:43:22.589274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-834099f8-4308-485e-96c2-c41fda90f71d req-ee865470-76b5-4952-baef-41e8387fe02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498b3941-d2e3-47c7-8698-80f4700cf25c", "name": "network-vif-deleted", "tag": "4d230fe7-cb42-4476-be5b-58a08b33d70f"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:22.589757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 492/959] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:22 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:22.600871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:22.600871 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:22.611263 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-834099f8-4308-485e-96c2-c41fda90f71d req-ee865470-76b5-4952-baef-41e8387fe02e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:22.611777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-834099f8-4308-485e-96c2-c41fda90f71d req-ee865470-76b5-4952-baef-41e8387fe02e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:22.630839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-834099f8-4308-485e-96c2-c41fda90f71d req-ee865470-76b5-4952-baef-41e8387fe02e service nova] Creating event network-vif-deleted:4d230fe7-cb42-4476-be5b-58a08b33d70f for instance 498b3941-d2e3-47c7-8698-80f4700cf25c on hv-cinder-74915 Dec 03 03:43:22.635894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-834099f8-4308-485e-96c2-c41fda90f71d req-ee865470-76b5-4952-baef-41e8387fe02e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056505 Dec 03 03:43:22.636556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 468/960] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:22 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:43:23.612390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:23.613054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 498b3941-d2e3-47c7-8698-80f4700cf25c] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:23.620932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.621434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:23.622292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.622825 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:23.678196 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Instance 498b3941-d2e3-47c7-8698-80f4700cf25c could not be found. Dec 03 03:43:23.678902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 404 to user: Instance 498b3941-d2e3-47c7-8698-80f4700cf25c could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:43:23.679791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-96536eec-44a7-49ae-ba0c-c2df342a4145 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c" status: 404 len: 111 microversion: 2.1 time: 0.076707 Dec 03 03:43:23.680377 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 493/961] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:23 2020] GET /compute/v2.1/servers/498b3941-d2e3-47c7-8698-80f4700cf25c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:43:23.695656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:23.696305 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:23.705513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.706012 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:23.706896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.707383 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:23.775927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:43:23.894655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-07fb59b7-cb8b-4b23-aa7d-0c38e6dbc596 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 204 len: 0 microversion: 2.1 time: 0.208639 Dec 03 03:43:23.896025 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 469/962] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:43:23 2020] DELETE /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:43:23.911341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:23.912017 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:23.921200 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.921714 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:23.922588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:23.923088 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:24.167628 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:24.176679 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-5e355c54-39b3-46a2-a1d4-96508b69e7df tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1514 microversion: 2.1 time: 0.276196 Dec 03 03:43:24.177282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 494/963] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:23 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:25.202027 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:25.202821 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:25.210685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:25.211189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:25.212015 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:25.212500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:25.451010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:25.460586 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-79667319-4487-4ef9-9c7b-cb4dabcb002d tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1514 microversion: 2.1 time: 0.268811 Dec 03 03:43:25.461145 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 470/964] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:25 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:25.730515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-4c1d61d9-5a69-45cd-9689-892dda25449e req-bbc2dd79-178f-4486-aa23-0fced6d5d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200cf6f2-e56b-4405-9227-8cab3717d3c4", "name": "network-vif-unplugged", "status": "completed", "tag": "c0531fe2-9f85-40bc-ac76-735de4473139"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:25.738295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:25.738295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:25.747404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-4c1d61d9-5a69-45cd-9689-892dda25449e req-bbc2dd79-178f-4486-aa23-0fced6d5d9bf service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:25.747914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-4c1d61d9-5a69-45cd-9689-892dda25449e req-bbc2dd79-178f-4486-aa23-0fced6d5d9bf service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:25.766608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-4c1d61d9-5a69-45cd-9689-892dda25449e req-bbc2dd79-178f-4486-aa23-0fced6d5d9bf service nova] Creating event network-vif-unplugged:c0531fe2-9f85-40bc-ac76-735de4473139 for instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 on hv-cinder-74915 Dec 03 03:43:25.771758 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-4c1d61d9-5a69-45cd-9689-892dda25449e req-bbc2dd79-178f-4486-aa23-0fced6d5d9bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050894 Dec 03 03:43:25.772637 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 495/965] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:25 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:26.486327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:26.486992 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:26.494828 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:26.495373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:26.496199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:26.496688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:26.926046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:26.934862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-193934b4-cb24-4a86-9d05-356ada513a12 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1514 microversion: 2.1 time: 0.458698 Dec 03 03:43:26.935766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 471/966] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:26 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:27.675147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c34ea194-e209-4ea4-ba4a-98a2b0eaf1d2 req-f18fd491-70f2-4153-84f3-531f550dfe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200cf6f2-e56b-4405-9227-8cab3717d3c4", "name": "network-vif-deleted", "tag": "c0531fe2-9f85-40bc-ac76-735de4473139"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:27.681874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:27.681874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:27.691447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c34ea194-e209-4ea4-ba4a-98a2b0eaf1d2 req-f18fd491-70f2-4153-84f3-531f550dfe6f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:27.691945 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c34ea194-e209-4ea4-ba4a-98a2b0eaf1d2 req-f18fd491-70f2-4153-84f3-531f550dfe6f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:27.711030 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c34ea194-e209-4ea4-ba4a-98a2b0eaf1d2 req-f18fd491-70f2-4153-84f3-531f550dfe6f service nova] Creating event network-vif-deleted:c0531fe2-9f85-40bc-ac76-735de4473139 for instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 on hv-cinder-74915 Dec 03 03:43:27.715804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c34ea194-e209-4ea4-ba4a-98a2b0eaf1d2 req-f18fd491-70f2-4153-84f3-531f550dfe6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051991 Dec 03 03:43:27.716444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 496/967] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:27 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:27.958624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:27.959284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:27.967096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:27.967738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:27.968562 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:27.969046 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:28.047199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:28.047691 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:28.048191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lazy-loading 'fault' on Instance uuid 200cf6f2-e56b-4405-9227-8cab3717d3c4 {{(pid=94249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:43:28.133798 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:28.143731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-dd6b08c4-80b6-4d41-a5d2-218b5ed4838a tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 200 len: 1308 microversion: 2.1 time: 0.194825 Dec 03 03:43:28.144527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 472/968] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:27 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:29.167461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:29.168137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: 200cf6f2-e56b-4405-9227-8cab3717d3c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:29.176921 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:29.177435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:29.178274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:29.178780 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:29.230707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 could not be found. Dec 03 03:43:29.231378 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 404 to user: Instance 200cf6f2-e56b-4405-9227-8cab3717d3c4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:43:29.232313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1bfdd096-fce6-4dab-abed-188e40897e22 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4" status: 404 len: 111 microversion: 2.1 time: 0.074541 Dec 03 03:43:29.233731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 497/969] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:29 2020] GET /compute/v2.1/servers/200cf6f2-e56b-4405-9227-8cab3717d3c4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:43:30.504214 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:30.504755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:30.512861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:30.514180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:30.515084 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:30.515579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:30.589219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:43:30.707112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-91713221-c75e-43c4-a60e-8b3eee6e9ac7 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "DELETE /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 204 len: 0 microversion: 2.1 time: 0.211447 Dec 03 03:43:30.707789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 473/970] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:43:30 2020] DELETE /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:43:30.721362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:30.722031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:30.729909 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:30.730463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:30.731297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:30.731791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:30.954666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:30.963612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c5c5b9f2-5ac2-4c4c-8ec4-3e1c83bd323c tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1512 microversion: 2.1 time: 0.251395 Dec 03 03:43:30.964149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 498/971] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:30 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:31.988724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:31.989490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:31.997390 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:31.998576 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:31.999420 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:31.999902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:32.228230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:32.237167 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-214e98f5-39b2-4b85-b80f-cbc8c6331973 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1512 microversion: 2.1 time: 0.258614 Dec 03 03:43:32.237810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 474/972] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:31 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:33.260113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:33.260769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:33.271197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:33.271867 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:33.273148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:33.273794 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:33.459047 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-94a7d8bb-9201-4122-842b-2ebe521dca74 req-8e5226a1-2fcf-4427-b5bb-4df3759621f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d47a6d-bc7c-4e50-b812-de4b30a745c4", "name": "network-vif-deleted", "tag": "e97f0326-6157-47c0-a379-98169e3d6388"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:33.461982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71edf5bf04244184946f7068094c1e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b073306a442b4c14b452213b4b59c308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:33.466392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:33.466392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:33.472180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-da402113-79c4-43bf-8a1b-931d603f26bc tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 200 len: 1470 microversion: 2.1 time: 0.221474 Dec 03 03:43:33.473199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 499/973] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:33 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:33.477376 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-94a7d8bb-9201-4122-842b-2ebe521dca74 req-8e5226a1-2fcf-4427-b5bb-4df3759621f6 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:33.477879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-94a7d8bb-9201-4122-842b-2ebe521dca74 req-8e5226a1-2fcf-4427-b5bb-4df3759621f6 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:33.496060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-94a7d8bb-9201-4122-842b-2ebe521dca74 req-8e5226a1-2fcf-4427-b5bb-4df3759621f6 service nova] Creating event network-vif-deleted:e97f0326-6157-47c0-a379-98169e3d6388 for instance f1d47a6d-bc7c-4e50-b812-de4b30a745c4 on hv-cinder-74915 Dec 03 03:43:33.501393 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-94a7d8bb-9201-4122-842b-2ebe521dca74 req-8e5226a1-2fcf-4427-b5bb-4df3759621f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052927 Dec 03 03:43:33.502044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 475/974] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:33 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:43:34.496272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:34.496868 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] [instance: f1d47a6d-bc7c-4e50-b812-de4b30a745c4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:34.505327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:34.505843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:34.506706 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:34.507209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:34.561486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] HTTP exception thrown: Instance f1d47a6d-bc7c-4e50-b812-de4b30a745c4 could not be found. Dec 03 03:43:34.561916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] Returning 404 to user: Instance f1d47a6d-bc7c-4e50-b812-de4b30a745c4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:43:34.562863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-38020251-7510-4f92-a998-561f1b469b16 tempest-AttachVolumeNegativeTest-839599602 tempest-AttachVolumeNegativeTest-839599602] 10.222.0.66 "GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4" status: 404 len: 111 microversion: 2.1 time: 0.075720 Dec 03 03:43:34.563487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 500/975] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:34 2020] GET /compute/v2.1/servers/f1d47a6d-bc7c-4e50-b812-de4b30a745c4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:43:51.234732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:43:51.235355 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:43:51 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:43:53.149117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:53.150482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:53.159340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:53.159925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:53.160751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:53.161232 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:53.236085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:43:53.349934 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c770f31d-9489-4fd1-9d8e-c63d6023d98f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 204 len: 0 microversion: 2.1 time: 0.211484 Dec 03 03:43:53.350621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 476/976] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:43:53 2020] DELETE /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:43:53.364924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:53.365599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:53.373502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:53.374038 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:53.374901 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:53.375401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:53.817019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:53.826537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9a3643f7-3bc5-494b-bedb-0d64677b637c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1585 microversion: 2.1 time: 0.471334 Dec 03 03:43:53.827280 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 501/977] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:53 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1585 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:54.851508 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:54.852291 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:54.860464 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:54.860979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:54.861819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:54.862340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:55.235155 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:55.244029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-36ec4a09-f873-45ca-8269-9ebc985fd3e8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1585 microversion: 2.1 time: 0.402609 Dec 03 03:43:55.244655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 477/978] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:54 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1585 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:55.848111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-9aea4b94-faeb-4c54-980a-8e976f769550 req-89f1cf24-ba18-4815-bf75-56ace3552041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be1987f-dbd5-4de9-836b-903aa98376a4", "name": "network-vif-unplugged", "status": "completed", "tag": "01a7c05b-85fc-46aa-9257-cbcd90973e50"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:55.855019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:55.855019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:55.864300 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9aea4b94-faeb-4c54-980a-8e976f769550 req-89f1cf24-ba18-4815-bf75-56ace3552041 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:55.864810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9aea4b94-faeb-4c54-980a-8e976f769550 req-89f1cf24-ba18-4815-bf75-56ace3552041 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:55.882893 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-9aea4b94-faeb-4c54-980a-8e976f769550 req-89f1cf24-ba18-4815-bf75-56ace3552041 service nova] Creating event network-vif-unplugged:01a7c05b-85fc-46aa-9257-cbcd90973e50 for instance 1be1987f-dbd5-4de9-836b-903aa98376a4 on hv-cinder-74915 Dec 03 03:43:55.888332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-9aea4b94-faeb-4c54-980a-8e976f769550 req-89f1cf24-ba18-4815-bf75-56ace3552041 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050025 Dec 03 03:43:55.889950 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 502/979] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:55 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:56.270947 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:56.271624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:56.279678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:56.280717 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:56.281613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:56.282115 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:56.510527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:56.520489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d8d88e4-bd40-4095-b0fb-b3db4ace23f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1585 microversion: 2.1 time: 0.260351 Dec 03 03:43:56.521033 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 478/980] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:56 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1585 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:57.547335 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:57.548158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:57.557875 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:57.558418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:57.559274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:57.559748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:57.822791 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:57.831930 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-93c0f5ea-d4a0-4250-86e8-ce225ba66771 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1511 microversion: 2.1 time: 0.295885 Dec 03 03:43:57.832749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 503/981] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:57 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:43:58.134589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-e4236c47-7d93-4a01-80e0-33e51255a7a3 req-ab244ea8-8bd8-499c-9896-ff67cf84f123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be1987f-dbd5-4de9-836b-903aa98376a4", "name": "network-vif-deleted", "tag": "01a7c05b-85fc-46aa-9257-cbcd90973e50"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:43:58.147666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:43:58.147666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:43:58.157285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e4236c47-7d93-4a01-80e0-33e51255a7a3 req-ab244ea8-8bd8-499c-9896-ff67cf84f123 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:58.158117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-e4236c47-7d93-4a01-80e0-33e51255a7a3 req-ab244ea8-8bd8-499c-9896-ff67cf84f123 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:58.215852 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-e4236c47-7d93-4a01-80e0-33e51255a7a3 req-ab244ea8-8bd8-499c-9896-ff67cf84f123 service nova] Creating event network-vif-deleted:01a7c05b-85fc-46aa-9257-cbcd90973e50 for instance 1be1987f-dbd5-4de9-836b-903aa98376a4 on hv-cinder-74915 Dec 03 03:43:58.221742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-e4236c47-7d93-4a01-80e0-33e51255a7a3 req-ab244ea8-8bd8-499c-9896-ff67cf84f123 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097669 Dec 03 03:43:58.222692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 479/982] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:43:58 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:43:58.856315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:43:58.856979 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:43:58.866359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:58.866870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:58.867736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:58.868226 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:58.951483 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:43:58.951946 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:43:58.952463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lazy-loading 'fault' on Instance uuid 1be1987f-dbd5-4de9-836b-903aa98376a4 {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:43:59.055522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:43:59.065757 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2374bd30-eb08-4579-b4cc-e73ad6f7b8c8 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 200 len: 1231 microversion: 2.1 time: 0.218720 Dec 03 03:43:59.066588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 504/983] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:43:58 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 1231 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:44:00.093365 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:00.094217 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:00.102831 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:00.103292 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:00.104149 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:00.104645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:00.159463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] HTTP exception thrown: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. Dec 03 03:44:00.160142 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Returning 404 to user: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:44:00.161060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ace7a855-9c35-48e4-8120-8b5076d3b588 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 404 len: 111 microversion: 2.1 time: 0.079890 Dec 03 03:44:00.162140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 480/984] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:00 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:44:00.297008 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1005657964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1492416280", "security_groups": [{"name": "tempest-TestVolumeBootPattern-385853502"}], "block_device_mapping_v2": [{"uuid": "14b256c8-e23b-490f-ad9d-cf805d9a1971", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:00.487237 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] validate_networks() for [('fbc7e55f-d22e-4329-970b-a9a3c37bd3aa', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:44:01.071768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:44:01.072240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:44:01.072776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:44:01.073230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:44:01.073685 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:44:01.083470 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:01.083968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:01.084809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:01.085489 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:01.104492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:44:01.108939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for user 6661ac0dfe6e4cec897fc10b23a7c8fe and project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:44:01.216427 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:44:01.219477 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14b256c8-e23b-490f-ad9d-cf805d9a1971',volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:44:01.394645 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7806622-91a4-48e5-a6e9-308246844627 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.106863 Dec 03 03:44:01.395543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 505/985] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:44:00 2020] POST /compute/v2.1/servers => generated 412 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:44:01.411058 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4be02064-d2a9-4829-94c8-7348eac8b772 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:01.411736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4be02064-d2a9-4829-94c8-7348eac8b772 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:01.500829 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4be02064-d2a9-4829-94c8-7348eac8b772 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:01.509233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4be02064-d2a9-4829-94c8-7348eac8b772 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1095 microversion: 2.1 time: 0.107297 Dec 03 03:44:01.509823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 481/986] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:01 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:02.535399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:02.536254 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:02.545256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:02.546537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:02.547542 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:02.548153 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:02.879789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:02.890952 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-63d19717-d222-47de-8907-d5521d06250b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1211 microversion: 2.1 time: 0.365027 Dec 03 03:44:02.891740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 506/987] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:02 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1211 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:03.915414 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:03.916269 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:03.926388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:03.927003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:03.927938 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:03.928516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:04.291823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:04.302732 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4245aa51-67b0-43f5-8341-b2a13f93b1aa tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.397452 Dec 03 03:44:04.303341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 482/988] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:03 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:05.332860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:05.333535 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:05.346350 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:05.346832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:05.347674 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:05.348163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:05.900754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:05.911964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-38db48ee-d9a6-4abd-b305-e371f33e5440 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.590676 Dec 03 03:44:05.912581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 507/989] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:05 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:05.975326 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-665f18dd-3830-4b6e-8eb1-f12ce08591c8 req-459b1f3e-47e3-4f81-8a66-d2508f5af8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:05.982168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:44:05.982168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:44:05.993463 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-665f18dd-3830-4b6e-8eb1-f12ce08591c8 req-459b1f3e-47e3-4f81-8a66-d2508f5af8a9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:05.994158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-665f18dd-3830-4b6e-8eb1-f12ce08591c8 req-459b1f3e-47e3-4f81-8a66-d2508f5af8a9 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:06.020635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-665f18dd-3830-4b6e-8eb1-f12ce08591c8 req-459b1f3e-47e3-4f81-8a66-d2508f5af8a9 service nova] Creating event network-changed:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:44:06.026364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-665f18dd-3830-4b6e-8eb1-f12ce08591c8 req-459b1f3e-47e3-4f81-8a66-d2508f5af8a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061664 Dec 03 03:44:06.027240 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 483/990] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:44:05 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:44:06.935999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:06.937544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:06.945719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:06.946230 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:06.947098 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:06.958915 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:07.336041 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:07.346071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-69bd8190-2e6c-401e-aa87-fec98f4f609f tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.418991 Dec 03 03:44:07.346956 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 508/991] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:06 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:08.370513 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:08.371609 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:08.380598 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:08.381099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:08.381924 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:08.382465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:08.612920 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:08.621784 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9b4b0a84-d746-4395-adc6-df21c3df6bb2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.261382 Dec 03 03:44:08.622401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 484/992] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:08 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:09.647064 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:09.647772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:09.656124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:09.656622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:09.657460 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:09.657949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:09.885793 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:09.895068 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f95f7979-75bf-45da-91a5-f1c89f309b16 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.258778 Dec 03 03:44:09.895671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 509/993] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:09 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:10.918848 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:10.919515 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:10.927978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:10.928484 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:10.929315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:10.929808 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:11.286657 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:11.296185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fe7c1716-066a-4c84-a91d-57cc997b4ebf tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.386266 Dec 03 03:44:11.296724 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 485/994] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:10 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:12.319260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:12.319936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:12.328511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:12.329021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:12.329859 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:12.330385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:12.550208 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:12.559031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bf05d746-87d8-4899-9d00-6a2568e62b2c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.249613 Dec 03 03:44:12.559619 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 510/995] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:12 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:13.583905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:13.584642 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:13.593512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:13.594456 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:13.595549 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:13.596114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:13.821948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:13.831165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c7dc815e-765e-407d-b8ee-efc226b44dd5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.257808 Dec 03 03:44:13.831755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 486/996] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:13 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:14.585432 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-c19715f3-5560-4d43-b094-12a329e31bf7 req-ebff90fc-9618-4bf2-8b6e-b9adacdda580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "name": "network-vif-plugged", "status": "completed", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:14.593505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:44:14.593505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:44:14.602593 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c19715f3-5560-4d43-b094-12a329e31bf7 req-ebff90fc-9618-4bf2-8b6e-b9adacdda580 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:14.603091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-c19715f3-5560-4d43-b094-12a329e31bf7 req-ebff90fc-9618-4bf2-8b6e-b9adacdda580 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:14.620635 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-c19715f3-5560-4d43-b094-12a329e31bf7 req-ebff90fc-9618-4bf2-8b6e-b9adacdda580 service nova] Creating event network-vif-plugged:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:44:14.625910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-c19715f3-5560-4d43-b094-12a329e31bf7 req-ebff90fc-9618-4bf2-8b6e-b9adacdda580 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050042 Dec 03 03:44:14.626630 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 511/997] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:44:14 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:44:14.856564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:14.857358 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:14.865436 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:14.865948 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:14.866823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:14.867315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:15.131461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:15.141373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e4d6ede0-0cec-4ac0-b2f4-481862287e9a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1273 microversion: 2.1 time: 0.294630 Dec 03 03:44:15.142010 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 487/998] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:14 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:16.176963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:16.192971 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:16.212581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:16.223101 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:16.224195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:16.224811 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:16.472504 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:16.481346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ed80ae8a-fc10-47d4-993a-f26580eeab5a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1459 microversion: 2.1 time: 0.314541 Dec 03 03:44:16.481939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 512/999] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:16 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1459 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:16.504492 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:16.505113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:16.513069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:16.513936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:16.515078 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:16.515648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:16.736304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:16.745707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3df59fac-7db2-4d43-9e94-e7786111d2b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1459 microversion: 2.1 time: 0.250508 Dec 03 03:44:16.746342 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 488/1000] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:16 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1459 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:16.771646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4d69f4b1-277a-40ca-8f90-4a5eb1ec2c24 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe9153fa7b8>, body: {"pool": null} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:19.096322 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4d69f4b1-277a-40ca-8f90-4a5eb1ec2c24 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.335237 Dec 03 03:44:19.097089 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 513/1001] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Dec 3 03:44:16 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:44:19.114496 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.160"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:19.115702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:19.123438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:19.124611 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:19.125444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:19.125927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:19.196581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Acquired lock "refresh_cache-a1b7ab21-18fb-4bd5-b849-de7313b88cc4" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:44:20.948849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:44:21.130220 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-526874a9-3b39-40f1-9f1f-2a65f49efdd4 req-48ee37b0-5468-4cc8-8b86-91af97aa6185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:21.138369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:44:21.138369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:44:21.149583 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-526874a9-3b39-40f1-9f1f-2a65f49efdd4 req-48ee37b0-5468-4cc8-8b86-91af97aa6185 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:21.150095 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-526874a9-3b39-40f1-9f1f-2a65f49efdd4 req-48ee37b0-5468-4cc8-8b86-91af97aa6185 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:21.170043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-526874a9-3b39-40f1-9f1f-2a65f49efdd4 req-48ee37b0-5468-4cc8-8b86-91af97aa6185 service nova] Creating event network-changed:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:44:21.177136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-526874a9-3b39-40f1-9f1f-2a65f49efdd4 req-48ee37b0-5468-4cc8-8b86-91af97aa6185 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221508 Dec 03 03:44:21.178585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 514/1002] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:44:20 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:44:21.713370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-194615523", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "539c3532-ac1d-471b-844a-83fd3585088c"}]}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:21.794866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] validate_networks() for [('539c3532-ac1d-471b-844a-83fd3585088c', None, None, None)] {{(pid=94250) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:44:23.362696 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Updating instance_info_cache with network_info: [{"id": "297083ec-7023-4e03-9c7f-ddad6427c76f", "address": "fa:16:3e:36:00:92", "network": {"id": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-148563040-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "53824ced637f4561a36b7f7aacf50bec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap297083ec-70", "ovs_interfaceid": "297083ec-7023-4e03-9c7f-ddad6427c76f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:44:23.365468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Flavor limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:44:23.365949 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Image limits 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:44:23.366759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Flavor pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:44:23.366994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Image pref 0:0:0 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:44:23.367459 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94250) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:44:23.375941 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Releasing lock "refresh_cache-a1b7ab21-18fb-4bd5-b849-de7313b88cc4" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:44:23.376874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-fc4d06ad-5ac4-4fa0-8afe-0a624c17406a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4/action" status: 202 len: 0 microversion: 2.1 time: 4.272227 Dec 03 03:44:23.377736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 489/1003] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:44:19 2020] POST /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4/action => generated 0 bytes in 4273 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 03:44:23.377849 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:23.378373 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:23.379311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:23.379812 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:23.400337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Getting quotas for project e5e0e53fa1cf4dadb1c43ad707e88957. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:44:23.404796 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Getting quotas for user 5020d3d1c1a3429cab84f7ebfea7601e and project e5e0e53fa1cf4dadb1c43ad707e88957. Resources: {'instances', 'ram', 'cores'} {{(pid=94250) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:44:23.416255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Going to run 1 instances... {{(pid=94250) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:44:23.419045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94250) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:44:23.470385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a73ca67c-cdc8-405b-8a19-0c107f0fe8e8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767411 Dec 03 03:44:23.471313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 515/1004] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:44:21 2020] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 03 03:44:23.488505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2eed4e47-9342-4520-8efa-b3cefb36d920 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:23.489102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2eed4e47-9342-4520-8efa-b3cefb36d920 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:23.581028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2eed4e47-9342-4520-8efa-b3cefb36d920 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:23.589082 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2eed4e47-9342-4520-8efa-b3cefb36d920 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1218 microversion: 2.1 time: 0.111162 Dec 03 03:44:23.589673 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 490/1005] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:23 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:24.613782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:24.614512 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:24.623045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:24.624123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:24.625260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:24.625752 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:24.779488 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:24.788905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef5e2500-59d1-4d5d-9c4a-508af621f766 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1288 microversion: 2.1 time: 0.185125 Dec 03 03:44:24.789575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 516/1006] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:24 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:25.812851 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:25.813520 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:25.822918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:25.823433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:25.824274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:25.824763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:26.315186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:26.323865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7bd87f88-f664-4456-9833-449c5b888a3c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1318 microversion: 2.1 time: 0.520512 Dec 03 03:44:26.324455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 491/1007] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:25 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:27.229660 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-3623a20a-41c2-4d48-a98e-54df704fe393 req-1ad3dcc0-2413-4ccc-932b-dee3373ef9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3d5bbc-0412-456b-9b15-b243d6cc6df4", "tag": "4a2e0fca-783b-4b4d-8267-f8409019d87c"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:27.237843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:44:27.237843 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:44:27.247725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3623a20a-41c2-4d48-a98e-54df704fe393 req-1ad3dcc0-2413-4ccc-932b-dee3373ef9eb service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:27.248236 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3623a20a-41c2-4d48-a98e-54df704fe393 req-1ad3dcc0-2413-4ccc-932b-dee3373ef9eb service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:27.267251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-3623a20a-41c2-4d48-a98e-54df704fe393 req-1ad3dcc0-2413-4ccc-932b-dee3373ef9eb service nova] Creating event network-changed:4a2e0fca-783b-4b4d-8267-f8409019d87c for instance 8c3d5bbc-0412-456b-9b15-b243d6cc6df4 on hv-cinder-74915 Dec 03 03:44:27.272180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-3623a20a-41c2-4d48-a98e-54df704fe393 req-1ad3dcc0-2413-4ccc-932b-dee3373ef9eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052805 Dec 03 03:44:27.272826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 517/1008] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:44:27 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:44:27.348618 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:27.349290 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:27.357138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:27.357648 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:27.358572 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:27.359073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:27.769686 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:27.778574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-9f4de029-bc7f-43f6-83d1-6ccad862c100 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1318 microversion: 2.1 time: 0.439870 Dec 03 03:44:27.779179 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 492/1009] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:27 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:28.803403 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:28.804102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:28.812349 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:28.812856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:28.813690 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:28.814186 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:29.178137 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:29.187902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b4b9ba2a-3e74-4d52-a99c-fd141528361c tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1318 microversion: 2.1 time: 0.394502 Dec 03 03:44:29.188699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 518/1010] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:28 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:30.211731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:30.212401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:30.221664 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:30.222173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:30.223049 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:30.223541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:30.442575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:30.451313 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1bf0ee40-2780-4675-b8ba-603ca07cf188 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1318 microversion: 2.1 time: 0.250059 Dec 03 03:44:30.452524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 493/1011] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:30 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:31.048441 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-bb680052-b111-4aa1-8727-a34fb0ca2722 req-d1ade965-61a1-4c68-89d9-5f178827ecee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d5bbc-0412-456b-9b15-b243d6cc6df4", "name": "network-vif-plugged", "status": "completed", "tag": "4a2e0fca-783b-4b4d-8267-f8409019d87c"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:31.055007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:44:31.055007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:44:31.064264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-bb680052-b111-4aa1-8727-a34fb0ca2722 req-d1ade965-61a1-4c68-89d9-5f178827ecee service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:31.064926 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-bb680052-b111-4aa1-8727-a34fb0ca2722 req-d1ade965-61a1-4c68-89d9-5f178827ecee service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:31.082919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-bb680052-b111-4aa1-8727-a34fb0ca2722 req-d1ade965-61a1-4c68-89d9-5f178827ecee service nova] Creating event network-vif-plugged:4a2e0fca-783b-4b4d-8267-f8409019d87c for instance 8c3d5bbc-0412-456b-9b15-b243d6cc6df4 on hv-cinder-74915 Dec 03 03:44:31.087918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-bb680052-b111-4aa1-8727-a34fb0ca2722 req-d1ade965-61a1-4c68-89d9-5f178827ecee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136547 Dec 03 03:44:31.088561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 519/1012] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:44:30 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:44:31.475112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:31.475782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:31.483976 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:31.484429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:31.485267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:31.485760 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:31.705662 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:31.714404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d6700e5-8609-4298-9dbf-385dbd52f5c3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1318 microversion: 2.1 time: 0.248669 Dec 03 03:44:31.714980 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 494/1013] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:31 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:44:32.739238 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:44:32.739939 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:32.748007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:32.749387 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:32.750204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:32.750726 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:32.971458 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:44:32.980284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b08a6c8d-23a6-4b72-8108-38291df1b938 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1507 microversion: 2.1 time: 0.251686 Dec 03 03:44:32.980880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 520/1014] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:44:32 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:44:51.211151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56fa532b-8a30-4ffe-b296-673677555a55", "device": "/dev/sdb"}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:44:51.212935 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:44:51.221894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:51.222879 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:51.224019 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:44:51.224517 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:44:51.616309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b41ab12a-de8e-4cd1-8ac2-5ae7af1326a4 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "POST /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414862 Dec 03 03:44:51.616963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 495/1015] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:44:51 2020] POST /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:45:15.448474 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:15.449077 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:15.457688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:15.458199 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:15.459108 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:15.459605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:15.778880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3089b641-71c4-424d-aa9f-5c7a3a14fcf3 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "DELETE /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4/os-volume_attachments/56fa532b-8a30-4ffe-b296-673677555a55" status: 202 len: 0 microversion: 2.1 time: 0.345871 Dec 03 03:45:15.779524 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 521/1016] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:45:15 2020] DELETE /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4/os-volume_attachments/56fa532b-8a30-4ffe-b296-673677555a55 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 03 03:45:17.043767 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:17.044426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:17.053224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:17.053734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:17.054614 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:17.055116 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:17.124433 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:45:17.244847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de9acfc7-e1c6-474a-adce-7e5c0ba6f6ec tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "DELETE /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 204 len: 0 microversion: 2.1 time: 0.210877 Dec 03 03:45:17.245392 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 496/1017] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:45:17 2020] DELETE /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:45:17.260840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:17.261612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:17.271259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:17.272987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:17.272987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:17.272987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:17.499106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:17.508707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-407b5518-6b8e-45cb-b484-bee355be6dbc tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1513 microversion: 2.1 time: 0.258417 Dec 03 03:45:17.509307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 522/1018] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:17 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:18.533647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:18.534466 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:18.542585 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:18.543094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:18.543927 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:18.544465 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:18.768437 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:18.778188 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e082ffeb-4440-49e0-a8df-b48951cd2b09 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1513 microversion: 2.1 time: 0.254428 Dec 03 03:45:18.778806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 497/1019] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:18 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:19.801567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:19.802270 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:19.810180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:19.810725 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:19.811579 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:19.812072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:19.969503 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:19.979321 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3ff06e51-25fb-48c3-9f29-5ae3595e0155 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 200 len: 1471 microversion: 2.1 time: 0.187022 Dec 03 03:45:19.980136 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 523/1020] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:19 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:20.047878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-a27eb32b-9a72-4c91-85d5-6730c865b881 req-1c1c9eb5-1927-4da6-9a2b-ade05ceaf1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3d5bbc-0412-456b-9b15-b243d6cc6df4", "name": "network-vif-deleted", "tag": "4a2e0fca-783b-4b4d-8267-f8409019d87c"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:45:20.056100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:45:20.056100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:45:20.066978 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a27eb32b-9a72-4c91-85d5-6730c865b881 req-1c1c9eb5-1927-4da6-9a2b-ade05ceaf1c1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:20.067502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a27eb32b-9a72-4c91-85d5-6730c865b881 req-1c1c9eb5-1927-4da6-9a2b-ade05ceaf1c1 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:20.086110 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-a27eb32b-9a72-4c91-85d5-6730c865b881 req-1c1c9eb5-1927-4da6-9a2b-ade05ceaf1c1 service nova] Creating event network-vif-deleted:4a2e0fca-783b-4b4d-8267-f8409019d87c for instance 8c3d5bbc-0412-456b-9b15-b243d6cc6df4 on hv-cinder-74915 Dec 03 03:45:20.091886 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-a27eb32b-9a72-4c91-85d5-6730c865b881 req-1c1c9eb5-1927-4da6-9a2b-ade05ceaf1c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053304 Dec 03 03:45:20.092544 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 498/1021] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:45:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:45:21.004287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:21.004823 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 8c3d5bbc-0412-456b-9b15-b243d6cc6df4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:21.012491 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:21.013006 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:21.013839 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:21.014620 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:21.067134 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] HTTP exception thrown: Instance 8c3d5bbc-0412-456b-9b15-b243d6cc6df4 could not be found. Dec 03 03:45:21.067800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Returning 404 to user: Instance 8c3d5bbc-0412-456b-9b15-b243d6cc6df4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:45:21.068702 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d8adde45-11b0-4389-9862-2f6e6d8d400f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4" status: 404 len: 111 microversion: 2.1 time: 0.074389 Dec 03 03:45:21.069311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 524/1022] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:20 2020] GET /compute/v2.1/servers/8c3d5bbc-0412-456b-9b15-b243d6cc6df4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:45:29.321755 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1997731298", "imageRef": "99bb550f-235a-4c31-969a-31f697b69553", "flavorRef": "452", "networks": [{"uuid": "539c3532-ac1d-471b-844a-83fd3585088c"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:45:29.399767 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] validate_networks() for [('539c3532-ac1d-471b-844a-83fd3585088c', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:45:29.956126 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:45:29.956605 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:45:29.957218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:45:29.957862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:45:29.958475 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:45:29.967386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:29.967890 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:29.968763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:29.969253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:29.988216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Getting quotas for project e5e0e53fa1cf4dadb1c43ad707e88957. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:45:29.992678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Getting quotas for user 5020d3d1c1a3429cab84f7ebfea7601e and project e5e0e53fa1cf4dadb1c43ad707e88957. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:45:30.003854 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:45:30.007303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bb550f-235a-4c31-969a-31f697b69553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:45:30.056550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4cf3e88f-8ad5-4f7d-bd1f-0616320e95cd tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745164 Dec 03 03:45:30.057252 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 499/1023] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:45:29 2020] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:45:30.073837 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-053eb1a7-8c6d-42df-a324-8732e8087160 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:30.074534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-053eb1a7-8c6d-42df-a324-8732e8087160 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:30.162567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-053eb1a7-8c6d-42df-a324-8732e8087160 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:30.170870 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-053eb1a7-8c6d-42df-a324-8732e8087160 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1219 microversion: 2.1 time: 0.106806 Dec 03 03:45:30.171490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 525/1024] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:30 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:31.195740 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:31.196348 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:31.204995 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:31.205516 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:31.206397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:31.206919 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:31.347164 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:31.357268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2d7874c6-553c-454d-a938-ee8b6a0a6e4a tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1271 microversion: 2.1 time: 0.171940 Dec 03 03:45:31.357874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 500/1025] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:31 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:32.383833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:32.384509 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:32.393316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:32.393853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:32.394735 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:32.395235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:32.562688 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:32.572285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-207e412f-dd54-46e3-b541-f86a08252af8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1277 microversion: 2.1 time: 0.198997 Dec 03 03:45:32.573099 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 526/1026] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:32 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:33.596135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:33.596918 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:33.604963 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:33.605473 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:33.606337 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:33.606840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:34.041783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:34.051185 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-219ead1d-63ea-4fd8-baf8-26f83e92dc06 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1319 microversion: 2.1 time: 0.464361 Dec 03 03:45:34.052198 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 501/1027] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:33 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:34.275404 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-3d5e8f42-2beb-4a0a-b099-128819e4f8df req-34e31145-dc71-461b-b7bf-f3d3251ab687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612db5e5-9f4f-4c9d-970e-3a8838b3ee33", "tag": "10272c2e-4af8-48b2-9ef0-8afc8067ee63"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:45:34.282669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:45:34.282669 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:45:34.292233 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3d5e8f42-2beb-4a0a-b099-128819e4f8df req-34e31145-dc71-461b-b7bf-f3d3251ab687 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:34.292739 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3d5e8f42-2beb-4a0a-b099-128819e4f8df req-34e31145-dc71-461b-b7bf-f3d3251ab687 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:34.310905 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-3d5e8f42-2beb-4a0a-b099-128819e4f8df req-34e31145-dc71-461b-b7bf-f3d3251ab687 service nova] Creating event network-changed:10272c2e-4af8-48b2-9ef0-8afc8067ee63 for instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 on hv-cinder-74915 Dec 03 03:45:34.315772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-3d5e8f42-2beb-4a0a-b099-128819e4f8df req-34e31145-dc71-461b-b7bf-f3d3251ab687 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050984 Dec 03 03:45:34.316418 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 527/1028] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:45:34 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:45:35.076003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:35.076678 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:35.085906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:35.086435 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:35.087301 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:35.087882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:35.485173 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:35.494396 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-69b7b808-e510-47c4-9afc-ecc5ea161497 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1319 microversion: 2.1 time: 0.427974 Dec 03 03:45:35.495043 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 502/1029] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:35 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:36.518588 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:36.519278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:36.530827 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:36.531328 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:36.532161 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:36.532652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:36.758621 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:36.767687 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8f6f41fc-ec46-40c1-8b2a-b844ff955bef tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1319 microversion: 2.1 time: 0.259067 Dec 03 03:45:36.768259 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 528/1030] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:36 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:37.790577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:37.791246 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:37.799097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:37.799599 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:37.800423 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:37.800914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:37.918219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-2847da33-e033-49e0-ada3-dceada64cb3a req-d781e014-90fa-43a3-a050-53226693fe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612db5e5-9f4f-4c9d-970e-3a8838b3ee33", "name": "network-vif-plugged", "status": "completed", "tag": "10272c2e-4af8-48b2-9ef0-8afc8067ee63"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:45:37.925169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:45:37.925169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:45:37.935482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2847da33-e033-49e0-ada3-dceada64cb3a req-d781e014-90fa-43a3-a050-53226693fe6e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:37.935906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-2847da33-e033-49e0-ada3-dceada64cb3a req-d781e014-90fa-43a3-a050-53226693fe6e service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:37.954479 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-2847da33-e033-49e0-ada3-dceada64cb3a req-d781e014-90fa-43a3-a050-53226693fe6e service nova] Creating event network-vif-plugged:10272c2e-4af8-48b2-9ef0-8afc8067ee63 for instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 on hv-cinder-74915 Dec 03 03:45:37.959844 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-2847da33-e033-49e0-ada3-dceada64cb3a req-d781e014-90fa-43a3-a050-53226693fe6e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052713 Dec 03 03:45:37.960720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 529/1031] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:45:37 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:45:38.025241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:38.034123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-3d62d5ea-011e-45c2-895d-508dac4309b6 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1319 microversion: 2.1 time: 0.252830 Dec 03 03:45:38.034786 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 503/1032] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:37 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:39.058327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:39.059096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:39.067218 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:39.067774 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:39.068601 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:39.069178 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:39.303054 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:39.311883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bc2b3851-56eb-4c78-be27-711ecdc29f8f tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1319 microversion: 2.1 time: 0.263101 Dec 03 03:45:39.312447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 530/1033] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:39 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:40.335902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:45:40.336539 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:40.344389 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:40.344892 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:40.345716 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:40.346201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:40.575759 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:45:40.585180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d7e8ca0-be48-4416-8315-5d266115b489 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1508 microversion: 2.1 time: 0.258705 Dec 03 03:45:40.585777 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 504/1034] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:45:40 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:45:40.608297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fc2c8dd-edda-46ee-be76-aac99dab5f55", "device": "/dev/sdb"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:45:40.609933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:45:40.617943 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:40.618482 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:40.619309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:45:40.619792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:45:41.007083 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e1328448-600d-45d6-a8b1-659078a3f996 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "POST /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408345 Dec 03 03:45:41.007742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 531/1035] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Dec 3 03:45:40 2020] POST /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:46:02.363005 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-406475013", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1492416280", "security_groups": [{"name": "tempest-TestVolumeBootPattern-385853502"}], "block_device_mapping_v2": [{"uuid": "66101694-a7d8-441a-bd1d-5ce36d52254e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa"}]}} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:02.563729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] validate_networks() for [('fbc7e55f-d22e-4329-970b-a9a3c37bd3aa', None, None, None)] {{(pid=94249) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 03 03:46:03.131397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 03 03:46:03.131914 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image limits 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 03 03:46:03.132494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Flavor pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 03 03:46:03.132958 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Image pref 0:0:0 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 03 03:46:03.133422 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.virt.hardware [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 03 03:46:03.144074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:03.144581 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:03.145454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:03.145990 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:03.164530 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 03 03:46:03.168652 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.quota [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Getting quotas for user 6661ac0dfe6e4cec897fc10b23a7c8fe and project 53824ced637f4561a36b7f7aacf50bec. Resources: {'instances', 'ram', 'cores'} {{(pid=94249) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 03 03:46:03.277364 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Going to run 1 instances... {{(pid=94249) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 03 03:46:03.279736 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66101694-a7d8-441a-bd1d-5ce36d52254e',volume_size=None,volume_type=None)] {{(pid=94249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 03 03:46:03.380779 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:03.381429 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:03.390805 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:03.391310 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:03.392140 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:03.392627 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:03.460951 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-74280ef8-9180-41b2-aded-02a0ba0ee4d5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.108342 Dec 03 03:46:03.461862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 505/1036] 10.222.0.66 () {60 vars in 1137 bytes} [Thu Dec 3 03:46:02 2020] POST /compute/v2.1/servers => generated 412 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 03 03:46:03.478052 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a76f248c-283c-4942-8997-dd4c14669dfb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:03.478762 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a76f248c-283c-4942-8997-dd4c14669dfb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:03.571036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a76f248c-283c-4942-8997-dd4c14669dfb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:03.581045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a76f248c-283c-4942-8997-dd4c14669dfb tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1094 microversion: 2.1 time: 0.112167 Dec 03 03:46:03.581818 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 506/1037] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:03 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:03.678028 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f526b94c-bdc9-425b-adf5-6ce99e8ada66 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "DELETE /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33/os-volume_attachments/8fc2c8dd-edda-46ee-be76-aac99dab5f55" status: 202 len: 0 microversion: 2.1 time: 0.307866 Dec 03 03:46:03.681928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 532/1038] 10.222.0.66 () {58 vars in 1406 bytes} [Thu Dec 3 03:46:03 2020] DELETE /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33/os-volume_attachments/8fc2c8dd-edda-46ee-be76-aac99dab5f55 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:46:04.725874 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:04.726589 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:04.735334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:04.735832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:04.736672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:04.737158 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:04.914511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:04.915578 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:04.925097 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:04.925771 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:04.926661 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:04.927165 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:04.949182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:04.959268 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-d0b8a033-73e8-465d-bda1-61abbd660405 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1200 microversion: 2.1 time: 0.363165 Dec 03 03:46:04.969932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 507/1039] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:04 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1200 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:05.006204 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:46:05.134295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-155fe0f7-787c-4d93-8fee-c09a96654a78 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "DELETE /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 204 len: 0 microversion: 2.1 time: 0.232962 Dec 03 03:46:05.135250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 533/1040] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:46:04 2020] DELETE /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:46:05.149806 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:05.150511 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:05.159936 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:05.160444 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:05.161284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:05.161772 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:05.517522 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:05.526833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-64cb1bcf-b39f-46b2-b2fd-a74d253785c8 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1514 microversion: 2.1 time: 0.386220 Dec 03 03:46:05.527425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 508/1041] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:05 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1514 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:05.984177 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:05.985295 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:05.993916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:05.994592 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:05.996315 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:05.996928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:06.444256 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:06.454311 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-cd549e1a-b7c1-40a3-be9c-89f777f19c77 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.480763 Dec 03 03:46:06.454931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 534/1042] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:05 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:06.551638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:06.552426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:06.561303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:06.561902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:06.562882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:06.563454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:07.355457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:07.364656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ab64168a-3fdf-40b4-b9b1-d2e273a5293e tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1514 microversion: 2.1 time: 0.823649 Dec 03 03:46:07.365265 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 509/1043] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:06 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1514 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:07.478916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:07.479500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:07.487426 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:07.487910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:07.488751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:07.489235 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:07.816617 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-906e9c0a-fa34-462c-ad32-49168bee4339 req-1ccf2925-8a0a-46b9-a488-477eeb084a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612db5e5-9f4f-4c9d-970e-3a8838b3ee33", "name": "network-vif-unplugged", "status": "completed", "tag": "10272c2e-4af8-48b2-9ef0-8afc8067ee63"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:07.824201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:46:07.824201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:46:07.834274 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-906e9c0a-fa34-462c-ad32-49168bee4339 req-1ccf2925-8a0a-46b9-a488-477eeb084a66 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:07.835021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-906e9c0a-fa34-462c-ad32-49168bee4339 req-1ccf2925-8a0a-46b9-a488-477eeb084a66 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:07.854094 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-906e9c0a-fa34-462c-ad32-49168bee4339 req-1ccf2925-8a0a-46b9-a488-477eeb084a66 service nova] Creating event network-vif-unplugged:10272c2e-4af8-48b2-9ef0-8afc8067ee63 for instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 on hv-cinder-74915 Dec 03 03:46:07.859853 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-906e9c0a-fa34-462c-ad32-49168bee4339 req-1ccf2925-8a0a-46b9-a488-477eeb084a66 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053148 Dec 03 03:46:07.861255 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 510/1044] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:46:07 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:46:08.341104 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:08.351493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f9e72048-c662-4dc9-85eb-1474520db6a5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.881813 Dec 03 03:46:08.352318 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 535/1045] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:07 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:08.389048 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:08.390241 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:08.399148 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:08.399763 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:08.400698 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:08.401284 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:08.786129 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:08.795183 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1a6f4f63-9590-41a2-b71c-1b3c421c143b tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1514 microversion: 2.1 time: 0.416182 Dec 03 03:46:08.795783 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 511/1046] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:08 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:08.959103 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-8790e1ba-5ed0-487e-8343-48b35c7fcb2f req-3b5bf5e9-69aa-43b2-aaf8-df02b06b8c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:08.966398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:46:08.966398 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:46:08.975712 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8790e1ba-5ed0-487e-8343-48b35c7fcb2f req-3b5bf5e9-69aa-43b2-aaf8-df02b06b8c24 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:08.976213 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-8790e1ba-5ed0-487e-8343-48b35c7fcb2f req-3b5bf5e9-69aa-43b2-aaf8-df02b06b8c24 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:09.000260 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-8790e1ba-5ed0-487e-8343-48b35c7fcb2f req-3b5bf5e9-69aa-43b2-aaf8-df02b06b8c24 service nova] Creating event network-changed:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:46:09.004882 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-8790e1ba-5ed0-487e-8343-48b35c7fcb2f req-3b5bf5e9-69aa-43b2-aaf8-df02b06b8c24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056139 Dec 03 03:46:09.005707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 536/1047] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:46:08 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:46:09.376809 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:09.377497 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:09.386663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:09.387316 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:09.388181 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:09.388719 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:09.819677 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:09.820446 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:09.829343 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:09.829845 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:09.830708 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:09.831197 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:10.142102 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:10.151191 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1b41f3f4-0ace-4bab-87e3-91d16b628bbe tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.784275 Dec 03 03:46:10.151902 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 512/1048] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:09 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:10.556379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5020d3d1c1a3429cab84f7ebfea7601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0e53fa1cf4dadb1c43ad707e88957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:10.565965 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7373c692-b116-44b2-b037-e1721ae20bf1 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 200 len: 1514 microversion: 2.1 time: 0.756092 Dec 03 03:46:10.566612 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 537/1049] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:09 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 1514 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 03 03:46:11.109123 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-9860523e-d6a1-4554-b022-08a59a780740 req-29622aad-2127-4fa0-970e-9403e8fe93fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612db5e5-9f4f-4c9d-970e-3a8838b3ee33", "name": "network-vif-deleted", "tag": "10272c2e-4af8-48b2-9ef0-8afc8067ee63"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:11.115787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:46:11.115787 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:46:11.125184 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9860523e-d6a1-4554-b022-08a59a780740 req-29622aad-2127-4fa0-970e-9403e8fe93fc service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:11.125711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-9860523e-d6a1-4554-b022-08a59a780740 req-29622aad-2127-4fa0-970e-9403e8fe93fc service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:11.144748 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-9860523e-d6a1-4554-b022-08a59a780740 req-29622aad-2127-4fa0-970e-9403e8fe93fc service nova] Creating event network-vif-deleted:10272c2e-4af8-48b2-9ef0-8afc8067ee63 for instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 on hv-cinder-74915 Dec 03 03:46:11.149861 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-9860523e-d6a1-4554-b022-08a59a780740 req-29622aad-2127-4fa0-970e-9403e8fe93fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050068 Dec 03 03:46:11.150577 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 513/1050] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:46:11 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:46:11.174574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:11.175347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:11.184486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:11.184700 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:11.185575 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:11.186468 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:11.532312 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:11.541534 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-8fa8cbb7-07ed-4ae1-b451-ccf85352d054 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.376143 Dec 03 03:46:11.543002 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 538/1051] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:11 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:11.592106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:11.592797 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] [instance: 612db5e5-9f4f-4c9d-970e-3a8838b3ee33] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:11.601212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:11.601722 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:11.602632 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:11.603106 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:11.659531 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] HTTP exception thrown: Instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 could not be found. Dec 03 03:46:11.660205 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] Returning 404 to user: Instance 612db5e5-9f4f-4c9d-970e-3a8838b3ee33 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:46:11.661124 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-bd8b7da1-53df-4cf0-8d13-ad7b03c73606 tempest-VolumesSnapshotTestJSON-745092061 tempest-VolumesSnapshotTestJSON-745092061] 10.222.0.66 "GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33" status: 404 len: 111 microversion: 2.1 time: 0.080517 Dec 03 03:46:11.661741 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 514/1052] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:11 2020] GET /compute/v2.1/servers/612db5e5-9f4f-4c9d-970e-3a8838b3ee33 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:46:12.566113 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:12.566815 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:12.575216 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:12.575723 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:12.576556 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:12.577057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:12.805189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:12.819602 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c8d4dcc0-1016-426d-a2ea-e1a94d532f96 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.263323 Dec 03 03:46:12.820141 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 539/1053] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:12 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:13.843363 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:13.844031 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:13.851988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:13.852500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:13.853341 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:13.853832 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:14.079239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:14.089707 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6a7de7d3-24a1-40e4-90eb-398994b26a67 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.255307 Dec 03 03:46:14.090541 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 515/1054] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:13 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:15.115189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:15.115847 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:15.123833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:15.124334 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:15.125160 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:15.125647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:15.345266 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:15.354021 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e7780e7a-eb9d-4a6c-b0ef-5bafe2de49ea tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.249948 Dec 03 03:46:15.354665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 540/1055] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:15 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:16.378336 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:16.378933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:16.388304 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:16.388800 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:16.389931 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:16.390450 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:16.653764 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:16.663439 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7b7ba91e-467d-4b29-95fa-b182b41b13c7 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.294850 Dec 03 03:46:16.664069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 516/1056] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:16 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:17.688658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:17.689332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:17.697332 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:17.697833 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:17.698769 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:17.699261 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:17.921922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:17.930768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-b25a10e7-cc4e-4b08-a853-de515336d0b4 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.251982 Dec 03 03:46:17.931370 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 541/1057] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:17 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:18.478346 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-3474d807-9cff-47f0-aec4-da5338d26985 req-06a98a47-cdeb-4cc7-8418-6183a3610794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "name": "network-vif-plugged", "status": "completed", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:18.485096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:46:18.485096 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:46:18.494638 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3474d807-9cff-47f0-aec4-da5338d26985 req-06a98a47-cdeb-4cc7-8418-6183a3610794 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:18.495144 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-3474d807-9cff-47f0-aec4-da5338d26985 req-06a98a47-cdeb-4cc7-8418-6183a3610794 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:18.513285 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-3474d807-9cff-47f0-aec4-da5338d26985 req-06a98a47-cdeb-4cc7-8418-6183a3610794 service nova] Creating event network-vif-plugged:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:46:18.518692 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-3474d807-9cff-47f0-aec4-da5338d26985 req-06a98a47-cdeb-4cc7-8418-6183a3610794 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049448 Dec 03 03:46:18.519359 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 517/1058] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:46:18 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:46:18.954974 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:18.955646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:18.965152 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:18.965671 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:18.966545 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:18.967045 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:19.191665 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:19.201281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-de002440-0be0-4287-8291-4fbdb8ae59e0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1272 microversion: 2.1 time: 0.256042 Dec 03 03:46:19.201883 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 542/1059] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:18 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:20.228081 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:20.228866 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:20.239105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:20.239622 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:20.240472 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:20.240968 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:20.466073 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:20.475059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-008712b2-f21e-4234-9ffd-b65f03636885 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1458 microversion: 2.1 time: 0.258615 Dec 03 03:46:20.475659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 518/1060] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:20 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1458 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:20.498287 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:46:20.498982 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:20.506826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:20.507338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:20.508163 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:20.508654 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:20.862711 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:46:20.872085 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-6c8dcbfa-ab8e-4504-a998-0e9c7c6bd8b2 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1458 microversion: 2.1 time: 0.382859 Dec 03 03:46:20.872672 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 543/1061] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:46:20 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1458 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:46:20.897338 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-f6d9ebe7-7a7a-4da9-bfab-9530435730c0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'create', calling method: .version_select at 0x7fe915458268>, body: {"pool": null} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:23.200813 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-f6d9ebe7-7a7a-4da9-bfab-9530435730c0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.314953 Dec 03 03:46:23.201624 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 519/1062] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Dec 3 03:46:20 2020] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:46:23.219075 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.70"}} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:23.220379 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:46:23.228537 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:23.229044 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:23.229988 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:23.230425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:23.301647 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Acquired lock "refresh_cache-5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:46:25.196067 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Building network info cache for instance {{(pid=94250) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:46:25.220053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-1caf5790-e566-4efe-931f-7626ef07f1a8 req-a4d6449c-41e2-4e70-9066-350ef4cf694f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:46:25.227339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:46:25.227339 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:46:25.237574 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-1caf5790-e566-4efe-931f-7626ef07f1a8 req-a4d6449c-41e2-4e70-9066-350ef4cf694f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:46:25.238447 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-1caf5790-e566-4efe-931f-7626ef07f1a8 req-a4d6449c-41e2-4e70-9066-350ef4cf694f service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:46:25.258668 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-1caf5790-e566-4efe-931f-7626ef07f1a8 req-a4d6449c-41e2-4e70-9066-350ef4cf694f service nova] Creating event network-changed:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:46:25.265262 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-1caf5790-e566-4efe-931f-7626ef07f1a8 req-a4d6449c-41e2-4e70-9066-350ef4cf694f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063332 Dec 03 03:46:25.266224 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 520/1063] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:46:25 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 03 03:46:26.217792 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Updating instance_info_cache with network_info: [{"id": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf", "address": "fa:16:3e:f1:b0:e0", "network": {"id": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-148563040-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "53824ced637f4561a36b7f7aacf50bec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf584c0fd-08", "ovs_interfaceid": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94250) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:46:26.235663 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Releasing lock "refresh_cache-5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:46:26.236894 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-681e2c4d-8e3c-4ebe-80e7-c3565a8fed38 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "POST /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec/action" status: 202 len: 0 microversion: 2.1 time: 3.027606 Dec 03 03:46:26.238100 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 544/1064] 10.222.0.66 () {60 vars in 1268 bytes} [Thu Dec 3 03:46:23 2020] POST /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec/action => generated 0 bytes in 3029 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 03 03:47:11.251916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:47:11.252490 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:47:11 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:47:15.577835 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:47:15.578502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:47:15 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:47:33.507564 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:47:33.508138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:47:33 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:47:53.106168 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '.version_select at 0x7fe9154581e0>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:47:53.606937 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:47:53.619195 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:53.619710 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:53.620567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:53.621060 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:53.683151 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Acquired lock "refresh_cache-5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:47:55.595658 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Building network info cache for instance {{(pid=94249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:47:55.610282 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-b7273cf0-6803-4fa4-8675-fe129b149d76 req-aca6b7b8-fa53-4e41-8b68-9656d454b84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:47:55.617138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:47:55.617138 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:47:55.627013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-b7273cf0-6803-4fa4-8675-fe129b149d76 req-aca6b7b8-fa53-4e41-8b68-9656d454b84c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:55.627526 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-b7273cf0-6803-4fa4-8675-fe129b149d76 req-aca6b7b8-fa53-4e41-8b68-9656d454b84c service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:55.646457 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-b7273cf0-6803-4fa4-8675-fe129b149d76 req-aca6b7b8-fa53-4e41-8b68-9656d454b84c service nova] Creating event network-changed:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:47:55.651729 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-b7273cf0-6803-4fa4-8675-fe129b149d76 req-aca6b7b8-fa53-4e41-8b68-9656d454b84c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050568 Dec 03 03:47:55.652560 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 545/1065] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:47:55 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:47:56.931176 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Updating instance_info_cache with network_info: [{"id": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf", "address": "fa:16:3e:f1:b0:e0", "network": {"id": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-148563040-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "53824ced637f4561a36b7f7aacf50bec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf584c0fd-08", "ovs_interfaceid": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:47:56.942356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Releasing lock "refresh_cache-5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" {{(pid=94249) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:47:56.943776 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-e1c7bb21-a5fc-42aa-9cee-8b52baea0340 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/65b9889f-0725-4a95-a531-c5b2af699939" status: 202 len: 0 microversion: 2.1 time: 3.849046 Dec 03 03:47:56.944401 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 521/1066] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:47:53 2020] DELETE /compute/v2.1/os-floating-ips/65b9889f-0725-4a95-a531-c5b2af699939 => generated 0 bytes in 3851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:47:56.959219 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:47:56.959916 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:47:56.968036 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:56.968567 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:56.969399 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:56.969906 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:57.042493 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Going to try to terminate instance {{(pid=94250) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:47:57.164169 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a55d8613-70ad-4f05-8791-578462303416 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 204 len: 0 microversion: 2.1 time: 0.214570 Dec 03 03:47:57.165053 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 546/1067] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:47:56 2020] DELETE /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:47:57.182860 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:47:57.183550 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:47:57.191862 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:57.192366 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:57.193212 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:57.193699 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:57.431385 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:47:57.440378 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-ef32e390-c7b6-471b-ba70-2ed9ff42661e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1464 microversion: 2.1 time: 0.270934 Dec 03 03:47:57.440985 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 522/1068] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:47:57 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1464 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:47:58.466154 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:47:58.466896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:47:58.474856 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:58.475360 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:58.476189 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:58.476682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:58.694356 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:47:58.703157 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-a28a6c33-b592-436a-9d32-7d44e4f2666c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1464 microversion: 2.1 time: 0.247656 Dec 03 03:47:58.703742 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 547/1069] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:47:58 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:47:59.100863 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-790be024-ec0f-4e3b-b091-58706b2ae621 req-3b0c5808-3d6f-4fab-8bc0-fa7b865627a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "name": "network-vif-unplugged", "status": "completed", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:47:59.107940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:47:59.107940 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:47:59.118264 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-790be024-ec0f-4e3b-b091-58706b2ae621 req-3b0c5808-3d6f-4fab-8bc0-fa7b865627a8 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:59.118928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-790be024-ec0f-4e3b-b091-58706b2ae621 req-3b0c5808-3d6f-4fab-8bc0-fa7b865627a8 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:59.138139 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-790be024-ec0f-4e3b-b091-58706b2ae621 req-3b0c5808-3d6f-4fab-8bc0-fa7b865627a8 service nova] Creating event network-vif-unplugged:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:47:59.144114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-790be024-ec0f-4e3b-b091-58706b2ae621 req-3b0c5808-3d6f-4fab-8bc0-fa7b865627a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053748 Dec 03 03:47:59.145007 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 523/1070] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:47:59 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:47:59.728035 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:47:59.728720 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:47:59.737057 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:59.737571 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:47:59.739201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:47:59.740369 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:00.042765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:00.052250 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7cdb0de9-6c79-4c96-9bf8-f9f3e3b15be6 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1390 microversion: 2.1 time: 0.334325 Dec 03 03:48:00.052855 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 548/1071] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:47:59 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:00.158970 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-a840276b-098a-4995-88f0-51b49c90b749 req-91ebb93c-78a2-416a-acd2-54ce5fa7347d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec", "name": "network-vif-deleted", "tag": "f584c0fd-0845-49b0-b65e-16cf1d25a6bf"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:48:00.167303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:48:00.167303 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:48:00.177324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a840276b-098a-4995-88f0-51b49c90b749 req-91ebb93c-78a2-416a-acd2-54ce5fa7347d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:00.177840 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-a840276b-098a-4995-88f0-51b49c90b749 req-91ebb93c-78a2-416a-acd2-54ce5fa7347d service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:00.195994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-a840276b-098a-4995-88f0-51b49c90b749 req-91ebb93c-78a2-416a-acd2-54ce5fa7347d service nova] Creating event network-vif-deleted:f584c0fd-0845-49b0-b65e-16cf1d25a6bf for instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec on hv-cinder-74915 Dec 03 03:48:00.201114 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-a840276b-098a-4995-88f0-51b49c90b749 req-91ebb93c-78a2-416a-acd2-54ce5fa7347d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053056 Dec 03 03:48:00.201765 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 524/1072] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:48:00 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:48:01.075309 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:01.075989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:01.083804 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:01.084308 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:01.085147 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:01.085643 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:01.165487 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:01.165999 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:01.166547 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.objects.instance [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lazy-loading 'fault' on Instance uuid 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec {{(pid=94250) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 03 03:48:01.273734 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:01.281751 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-77fe3b52-2fa2-484b-b49a-f63a2ff2f28e tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 200 len: 1184 microversion: 2.1 time: 0.216409 Dec 03 03:48:01.282354 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 549/1073] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:01 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 1184 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:02.306987 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:02.308128 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:02.316538 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:02.317553 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:02.318425 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:02.318923 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:02.378059 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] HTTP exception thrown: Instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec could not be found. Dec 03 03:48:02.378731 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Returning 404 to user: Instance 5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:48:02.380074 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-684b3493-37c8-4324-826e-187fd3b13462 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec" status: 404 len: 111 microversion: 2.1 time: 0.083856 Dec 03 03:48:02.380689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 525/1074] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:02 2020] GET /compute/v2.1/servers/5db1ce50-8adc-4dab-9ba2-ed273e6ed5ec => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:48:04.822495 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '.version_select at 0x7fe916a5aea0>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:05.329561 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:05.338745 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:05.339253 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:05.340091 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:05.340582 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:05.402209 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Acquired lock "refresh_cache-a1b7ab21-18fb-4bd5-b849-de7313b88cc4" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 03 03:48:07.085239 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Building network info cache for instance {{(pid=94250) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 03 03:48:07.099701 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-98342946-03c7-4c99-b9dd-cfda6d261c23 req-757dc2b5-e3b4-43af-b4cf-3004e4775305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:48:07.106388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:48:07.106388 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:48:07.116505 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-98342946-03c7-4c99-b9dd-cfda6d261c23 req-757dc2b5-e3b4-43af-b4cf-3004e4775305 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:07.117013 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-98342946-03c7-4c99-b9dd-cfda6d261c23 req-757dc2b5-e3b4-43af-b4cf-3004e4775305 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:07.135962 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-98342946-03c7-4c99-b9dd-cfda6d261c23 req-757dc2b5-e3b4-43af-b4cf-3004e4775305 service nova] Creating event network-changed:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:48:07.142112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-98342946-03c7-4c99-b9dd-cfda6d261c23 req-757dc2b5-e3b4-43af-b4cf-3004e4775305 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052128 Dec 03 03:48:07.143024 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 526/1075] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:48:07 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:48:08.835455 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.network.neutron [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Updating instance_info_cache with network_info: [{"id": "297083ec-7023-4e03-9c7f-ddad6427c76f", "address": "fa:16:3e:36:00:92", "network": {"id": "fbc7e55f-d22e-4329-970b-a9a3c37bd3aa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-148563040-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "53824ced637f4561a36b7f7aacf50bec", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap297083ec-70", "ovs_interfaceid": "297083ec-7023-4e03-9c7f-ddad6427c76f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94250) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 03 03:48:08.843340 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Releasing lock "refresh_cache-a1b7ab21-18fb-4bd5-b849-de7313b88cc4" {{(pid=94250) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 03 03:48:08.844272 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-481e72ec-8cb2-498f-af59-6be021ab5376 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/ce135385-229c-43b7-905e-38cda51b5d1e" status: 202 len: 0 microversion: 2.1 time: 4.031580 Dec 03 03:48:08.844925 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 550/1076] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:48:04 2020] DELETE /compute/v2.1/os-floating-ips/ce135385-229c-43b7-905e-38cda51b5d1e => generated 0 bytes in 4033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:48:08.860180 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:08.860822 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:08.869397 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:08.869896 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:08.870766 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:08.871251 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:08.940201 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Going to try to terminate instance {{(pid=94249) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 03 03:48:09.052636 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-c3700a25-e0d9-468c-8fe5-d098349be35a tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 204 len: 0 microversion: 2.1 time: 0.201886 Dec 03 03:48:09.053267 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 527/1077] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:48:08 2020] DELETE /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 03 03:48:09.068070 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:09.068738 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:09.076666 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:09.077172 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:09.078003 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:09.078521 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:09.319969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94250) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:09.328865 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-63c3d2e7-6dac-4703-add3-e38fe48c0d4b tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1465 microversion: 2.1 time: 0.270714 Dec 03 03:48:09.329454 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 551/1078] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:09 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:10.354330 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:10.355111 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:10.362994 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:10.363506 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:10.365156 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:10.365646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:10.594626 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:10.603749 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-1eaa3dce-8594-4aa7-b8f5-e4724c8352e9 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1465 microversion: 2.1 time: 0.260080 Dec 03 03:48:10.604357 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 528/1079] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:10 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:11.218020 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-952bfcc7-b8bb-4fa6-8bd6-8c95cbefbf1e req-adb9b14c-a2d6-4f44-89b0-c1f0a72a0a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "name": "network-vif-unplugged", "status": "completed", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:48:11.228278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:48:11.228278 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:48:11.237646 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-952bfcc7-b8bb-4fa6-8bd6-8c95cbefbf1e req-adb9b14c-a2d6-4f44-89b0-c1f0a72a0a07 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:11.238143 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-952bfcc7-b8bb-4fa6-8bd6-8c95cbefbf1e req-adb9b14c-a2d6-4f44-89b0-c1f0a72a0a07 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:11.256810 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-952bfcc7-b8bb-4fa6-8bd6-8c95cbefbf1e req-adb9b14c-a2d6-4f44-89b0-c1f0a72a0a07 service nova] Creating event network-vif-unplugged:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:48:11.262072 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-952bfcc7-b8bb-4fa6-8bd6-8c95cbefbf1e req-adb9b14c-a2d6-4f44-89b0-c1f0a72a0a07 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055849 Dec 03 03:48:11.262964 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 552/1080] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:48:11 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:48:11.627023 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:11.627689 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:11.636117 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:11.636608 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:11.637451 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:11.637932 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:11.858297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:11.867878 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-85a07c4d-27b1-44e6-af23-ea8638ddd7ff tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1465 microversion: 2.1 time: 0.250033 Dec 03 03:48:11.868471 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 529/1081] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:11 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1465 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:12.660362 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [req-d6b0e92d-8e73-4683-ba2c-60a7f3d6a32a req-67ea9f6a-fd9f-4d93-a9ea-25b1ea67bba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b7ab21-18fb-4bd5-b849-de7313b88cc4", "name": "network-vif-deleted", "tag": "297083ec-7023-4e03-9c7f-ddad6427c76f"}]} {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 03 03:48:12.668461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 03 03:48:12.668461 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: warnings.warn(msg) Dec 03 03:48:12.679933 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d6b0e92d-8e73-4683-ba2c-60a7f3d6a32a req-67ea9f6a-fd9f-4d93-a9ea-25b1ea67bba8 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:12.680431 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [req-d6b0e92d-8e73-4683-ba2c-60a7f3d6a32a req-67ea9f6a-fd9f-4d93-a9ea-25b1ea67bba8 service nova] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:12.699922 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.compute.server_external_events [req-d6b0e92d-8e73-4683-ba2c-60a7f3d6a32a req-67ea9f6a-fd9f-4d93-a9ea-25b1ea67bba8 service nova] Creating event network-vif-deleted:297083ec-7023-4e03-9c7f-ddad6427c76f for instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 on hv-cinder-74915 Dec 03 03:48:12.704768 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [req-d6b0e92d-8e73-4683-ba2c-60a7f3d6a32a req-67ea9f6a-fd9f-4d93-a9ea-25b1ea67bba8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054421 Dec 03 03:48:12.705424 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 553/1082] 10.222.0.66 () {64 vars in 1308 bytes} [Thu Dec 3 03:48:12 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 03 03:48:12.891656 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:12.892307 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:12.900327 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:12.900789 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:12.901613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:12.902105 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:13.054523 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.policy [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661ac0dfe6e4cec897fc10b23a7c8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53824ced637f4561a36b7f7aacf50bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94249) authorize /opt/stack/nova/nova/policy.py:225}} Dec 03 03:48:13.063819 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-7d41028d-9359-4be6-8d2a-df3c263fc950 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 200 len: 1226 microversion: 2.1 time: 0.181308 Dec 03 03:48:13.065651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 530/1083] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:12 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 1226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 03 03:48:14.088135 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:14.088904 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: a1b7ab21-18fb-4bd5-b849-de7313b88cc4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:14.096991 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:14.097500 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:14.098417 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:14.098911 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:14.152297 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] HTTP exception thrown: Instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 could not be found. Dec 03 03:48:14.152983 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Returning 404 to user: Instance a1b7ab21-18fb-4bd5-b849-de7313b88cc4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:48:14.153880 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-56b70f05-8ce8-4d07-8fc7-ffa1cd7bed8c tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4" status: 404 len: 111 microversion: 2.1 time: 0.076072 Dec 03 03:48:14.154527 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 554/1084] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:14 2020] GET /compute/v2.1/servers/a1b7ab21-18fb-4bd5-b849-de7313b88cc4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:48:14.168969 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-57314e4f-b32e-41a6-bb15-9035ab2a65ab tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '.version_select at 0x7fe915752158>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:15.762961 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-57314e4f-b32e-41a6-bb15-9035ab2a65ab tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/7b8e98a8-c6c0-4286-a386-bf9b4cade84d" status: 202 len: 0 microversion: 2.1 time: 1.603569 Dec 03 03:48:15.763613 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 531/1085] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:48:14 2020] DELETE /compute/v2.1/os-floating-ips/7b8e98a8-c6c0-4286-a386-bf9b4cade84d => generated 0 bytes in 1605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:48:15.778029 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:15.778623 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94250) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:15.786928 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:15.787434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:15.788258 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:15.788737 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94250) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:15.839782 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] HTTP exception thrown: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. Dec 03 03:48:15.840438 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Returning 404 to user: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. {{(pid=94250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:48:15.841320 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-2a21ab56-298c-4cdc-8b8a-ef483fc8f8a0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 404 len: 111 microversion: 2.1 time: 0.072896 Dec 03 03:48:15.841910 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 555/1086] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Dec 3 03:48:15 2020] DELETE /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:48:15.856382 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:15.857004 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.compute.api [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] [instance: 1be1987f-dbd5-4de9-836b-903aa98376a4] Fetching instance by UUID {{(pid=94249) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 03 03:48:15.866112 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:15.866649 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:15.867486 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 03 03:48:15.867981 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG oslo_concurrency.lockutils [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Lock "d6211385-f358-428e-b9cb-f335d3904874" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94249) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 03 03:48:15.923659 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.wsgi [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] HTTP exception thrown: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. Dec 03 03:48:15.924324 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Returning 404 to user: Instance 1be1987f-dbd5-4de9-836b-903aa98376a4 could not be found. {{(pid=94249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 03 03:48:15.925225 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-23a8fd86-dd8d-4e6b-bbb5-1f8298006351 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4" status: 404 len: 111 microversion: 2.1 time: 0.078755 Dec 03 03:48:15.925826 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 532/1087] 10.222.0.66 () {58 vars in 1226 bytes} [Thu Dec 3 03:48:15 2020] GET /compute/v2.1/servers/1be1987f-dbd5-4de9-836b-903aa98376a4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 03 03:48:17.183386 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-4623ceac-47bf-45e0-a7f8-68829482f9f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '.version_select at 0x7fe91559c950>' {{(pid=94250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:17.435434 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-4623ceac-47bf-45e0-a7f8-68829482f9f0 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/57c2dd8e-b1a2-4d1f-bc11-1e75d7985578" status: 202 len: 0 microversion: 2.1 time: 0.262242 Dec 03 03:48:17.436069 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94250|app: 0|req: 556/1088] 10.222.0.66 () {58 vars in 1262 bytes} [Thu Dec 3 03:48:17 2020] DELETE /compute/v2.1/os-security-groups/57c2dd8e-b1a2-4d1f-bc11-1e75d7985578 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:48:17.450182 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: DEBUG nova.api.openstack.wsgi [None req-42e93984-0307-44d9-a6a0-6901b756bff5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] Calling method '.version_select at 0x7fe915458840>' {{(pid=94249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 03 03:48:17.477026 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO nova.api.openstack.requestlog [None req-42e93984-0307-44d9-a6a0-6901b756bff5 tempest-TestVolumeBootPattern-1332458828 tempest-TestVolumeBootPattern-1332458828] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1492416280" status: 202 len: 0 microversion: 2.1 time: 0.036236 Dec 03 03:48:17.477651 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: [pid: 94249|app: 0|req: 533/1089] 10.222.0.66 () {58 vars in 1253 bytes} [Thu Dec 3 03:48:17 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1492416280 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 03 03:48:48.023494 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:48:48.024071 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:48:48 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:50:31.269989 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:50:31.270682 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:50:31 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:50:53.525347 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:50:53.525913 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:50:53 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:50:56.482959 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:50:56.483543 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:50:56 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:52:08.040655 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:52:08.041281 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:52:08 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:53:51.287917 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:53:51.288502 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:53:51 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 03 03:53:55.598754 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 03 03:53:55.599323 dv-cinder-749155-3-iscsi devstack@n-api.service[94247]: Thu Dec 3 03:53:55 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!